Nov 05 09:19:49 devstack cinder-volume[75407]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 05 09:19:49 devstack cinder-volume[75407]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 09:19:49 devstack cinder-volume[75407]: we strongly recommend against using it for new projects.
Nov 05 09:19:49 devstack cinder-volume[75407]: If you are already using Eventlet, we recommend migrating to a different
Nov 05 09:19:49 devstack cinder-volume[75407]: framework.  For more detail see
Nov 05 09:19:49 devstack cinder-volume[75407]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 09:19:49 devstack cinder-volume[75407]:   import eventlet  # noqa
Nov 05 09:19:52 devstack cinder-volume[75407]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75407) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 09:19:52 devstack cinder-volume[75407]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75407) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 09:19:52 devstack cinder-volume[75407]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75407) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 09:19:53 devstack cinder-volume[75407]: INFO dbcounter [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] Registered counter for database cinder
Nov 05 09:19:53 devstack cinder-volume[75407]: DEBUG oslo_db.sqlalchemy.engines [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75407) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 09:19:54 devstack cinder-volume[75407]: DEBUG dbcounter [-] [75407] Writer thread running {{(pid=75407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 09:19:54 devstack cinder-volume[75407]: INFO cinder.rpc [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 05 09:19:54 devstack cinder-volume[75407]: INFO cinder.rpc [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 05 09:19:54 devstack cinder-volume[75407]: DEBUG oslo_db.sqlalchemy.engines [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75407) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 09:19:54 devstack cinder-volume[75407]: INFO cinder.volume.manager [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] Determined volume DB was empty at startup.
Nov 05 09:19:54 devstack cinder-volume[75407]: DEBUG cinder.volume.manager [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75407) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 05 09:19:54 devstack cinder-volume[75407]: INFO cinder.volume.manager [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 05 09:19:54 devstack cinder-volume[75407]: WARNING stevedore.named [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 09:19:54 devstack cinder-volume[75407]: WARNING castellan.key_manager [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 09:19:54 devstack cinder-volume[75407]: WARNING cinder.keymgr.conf_key_mgr [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 09:19:54 devstack cinder-volume[75407]: DEBUG cinder.volume.drivers.lvm [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75407) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Nov 05 09:19:54 devstack cinder-volume[75407]: DEBUG oslo_concurrency.processutils [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:19:54 devstack cinder-volume[75407]: DEBUG oslo_concurrency.processutils [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] CMD "cinder-rtstool verify" returned: 0 in 0.516s {{(pid=75407) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:19:54 devstack cinder-volume[75407]: DEBUG oslo_db.sqlalchemy.engines [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75407) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 09:19:54 devstack cinder-volume[75407]: INFO cinder.rpc [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Nov 05 09:19:55 devstack cinder-volume[75407]: INFO cinder.rpc [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Nov 05 09:19:55 devstack cinder-volume[75407]: WARNING stevedore.named [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 09:19:55 devstack cinder-volume[75407]: WARNING castellan.key_manager [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 09:19:55 devstack cinder-volume[75407]: INFO cinder.volume.manager [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_db.sqlalchemy.engines [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75407) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 09:19:55 devstack cinder-volume[75407]: INFO oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] Starting 1 workers
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] Started child 75556 {{(pid=75407) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] Full set of CONF: {{(pid=75407) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] ******************************************************************************** {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] Configuration options gathered from: {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] ================================================================================ {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] allow_availability_zone_fallback = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75556]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] allow_compression_on_image_upload = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] allowed_direct_url_schemes     = [] {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] api_rate_limit                 = True {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] auth_strategy                  = keystone {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] az_cache_duration              = 3600 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_availability_zone      = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_host                   = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_name                   = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_stats_polling_interval = 60 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backup_api_class               = cinder.backup.api.API {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backup_name_template           = backup-%s {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backup_use_same_host           = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backup_use_temp_snapshot       = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] chap_password                  = **** {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] chap_username                  =  {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cinder_internal_tenant_project_id = 3a3087dd1fca4b0f8ad751e6a8643056 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cinder_internal_tenant_user_id = 43fb5a6c7fa64c4fbd8151fc0bd16c76 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cloned_volume_same_az          = True {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cluster                        = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] compression_format             = gzip {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] config_dir                     = [] {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] config_source                  = [] {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] control_exchange               = openstack {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] debug                          = True {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] default_availability_zone      = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] default_group_type             = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] default_volume_type            = lvmdriver-1 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] disk_geometry                  = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] driver_client_cert             = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] driver_client_cert_key         = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] driver_data_namespace          = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] driver_ssl_cert_path           = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] driver_ssl_cert_verify         = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] driver_use_ssl                 = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] enable_force_upload            = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] enable_new_services            = True {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] enable_unsupported_driver      = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] enforce_multipath_for_image_xfer = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] filter_function                = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] glance_api_insecure            = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] glance_api_servers             = ['http://192.168.122.7/image'] {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] glance_api_ssl_compression     = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] glance_ca_certificates_file    = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] glance_certfile                = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] glance_keyfile                 = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] glance_num_retries             = 3 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] glance_request_timeout         = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] goodness_function              = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] graceful_shutdown_timeout      = 5 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] group_api_class                = cinder.group.api.API {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] host                           = devstack {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] image_compress_on_upload       = True {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] image_conversion_address_space_limit = 1 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] image_conversion_cpu_limit     = 60 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] image_conversion_disable       = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] image_introspection_address_space_limit = 1 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] image_introspection_cpu_limit  = 60 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] image_upload_use_cinder_backend = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] image_upload_use_internal_tenant = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] image_volume_cache_enabled     = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] image_volume_cache_max_count   = 0 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] image_volume_cache_max_size_gb = 0 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] init_host_max_objects_retrieval = 0 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75556]: INFO cinder.volume.manager [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Starting volume driver LVMVolumeDriver (3.0.0)
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] iscsi_target_flags             =  {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] iscsi_write_cache              = on {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] iser_helper                    = tgtadm {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] iser_ip_address                = 192.168.122.7 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] iser_port                      = 3260 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] log_color                      = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] log_config_append              = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] log_dir                        = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] log_file                       = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] log_options                    = True {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] log_rotate_interval            = 1 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] log_rotate_interval_type       = days {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] log_rotation_type              = none {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] max_age                        = 0 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] max_logfile_count              = 30 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] max_logfile_size_mb            = 200 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] max_over_subscription_ratio    = 20.0 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] message_reap_interval          = 86400 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] message_ttl                    = 2592000 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] migration_create_volume_timeout_secs = 300 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] monkey_patch                   = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] monkey_patch_modules           = [] {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] my_ip                          = 192.168.122.7 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] no_snapshot_gb_quota           = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] num_iser_scan_tries            = 3 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] num_shell_tries                = 3 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] num_volume_device_scan_tries   = 3 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] nvmeof_conn_info_version       = 1 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] nvmet_ns_id                    = 10 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] nvmet_port_id                  = 1 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] osapi_max_limit                = 1000 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] osapi_volume_ext_list          = [] {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] osapi_volume_listen_port       = 8776 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] osapi_volume_use_ssl           = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] osapi_volume_workers           = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] per_volume_size_limit          = -1 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] periodic_fuzzy_delay           = 60 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] periodic_interval              = 60 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] public_endpoint                = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] publish_errors                 = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] quota_backup_gigabytes         = 1000 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] quota_backups                  = 10 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] quota_gigabytes                = 1000 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] quota_groups                   = 10 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] quota_snapshots                = 10 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] quota_volumes                  = 10 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] rate_limit_burst               = 0 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] rate_limit_except_level        = CRITICAL {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] rate_limit_interval            = 0 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] reinit_driver_count            = 3 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] replication_device             = **** {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] report_discard_supported       = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] report_interval                = 120 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] reservation_clean_interval     = 86400 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] reservation_expire             = 86400 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] reserved_image_namespaces      = [] {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] reserved_percentage            = 0 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] rpc_response_timeout           = 120 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] run_external_periodic_tasks    = True {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] scst_target_driver             = iscsi {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] scst_target_iqn_name           = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] service_down_time              = 720 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] shell_completion               = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] snapshot_name_template         = snapshot-%s {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] snapshot_same_host             = True {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] split_loggers                  = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] state_path                     = /opt/stack/data/cinder {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] storage_availability_zone      = nova {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] storage_protocol               = iSCSI {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] syslog_log_facility            = LOG_USER {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] target_helper                  = lioadm {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] target_ip_address              = 192.168.122.7 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] target_port                    = 3260 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] target_protocol                = iscsi {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] target_secondary_ip_addresses  = [] {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] trace_flags                    = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] transport_url                  = **** {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] until_refresh                  = 0 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] use_chap_auth                  = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] use_default_quota_class        = True {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] use_journal                    = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] use_json                       = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] use_multipath_for_image_xfer   = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] use_stderr                     = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] use_syslog                     = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] verify_glance_signatures       = enabled {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] volume_api_class               = cinder.volume.api.API {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] volume_backend_name            = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] volume_clear                   = zero {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] volume_clear_ionice            = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] volume_clear_size              = 0 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] volume_copy_bps_limit          = 0 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] volume_dd_blocksize            = 1M {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] volume_name_template           = volume-%s {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:19:55 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] volume_service_inithost_offload = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] volume_usage_audit_period      = month {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] zoning_mode                    = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_concurrency.disable_process_locking = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.auth_section = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.auth_type   = password {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.auth_version = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.cache       = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.certfile    = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.include_service_catalog = True {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.insecure    = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.interface   = public {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.keyfile     = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.memcache_password = **** {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.memcache_username = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.region_name = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.service_type = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.7/identity {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack sudo[75563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Nov 05 09:19:55 devstack sudo[75563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.backend                  = dogpile.cache.null {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.backend_argument         = **** {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.backend_expiration_time  = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.config_prefix            = cache.oslo {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.debug_cache_backend      = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.enable_retry_client      = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.enable_socket_keepalive  = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.enabled                  = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.expiration_time          = 600 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.hashclient_retry_attempts = 2 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.memcache_dead_retry      = 300 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.memcache_sasl_enabled    = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.password                 = **** {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.proxies                  = [] {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.redis_db                 = 0 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.redis_server             = localhost:6379 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.retry_attempts           = 2 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.retry_delay              = 0.0 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.socket_keepalive_count   = 1 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.socket_keepalive_idle    = 1 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.socket_keepalive_interval = 1 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.socket_timeout           = 1.0 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.tls_allowed_ciphers      = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.tls_cafile               = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.tls_certfile             = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.tls_enabled              = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.tls_keyfile              = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cache.username                 = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] coordination.backend_url       = **** {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] database.asyncio_connection    = **** {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] database.asyncio_slave_connection = **** {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] database.backend               = sqlalchemy {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] database.connection            = **** {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] database.connection_debug      = 0 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] database.connection_parameters =  {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] database.connection_recycle_time = 3600 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] database.connection_trace      = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] database.db_inc_retry_interval = True {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] database.db_max_retries        = 20 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] database.db_max_retry_interval = 10 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] database.db_retry_interval     = 1 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] database.max_overflow          = 50 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] database.max_pool_size         = 5 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] database.max_retries           = 10 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] database.mysql_wsrep_sync_wait = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] database.pool_timeout          = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] database.retry_interval        = 10 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] database.slave_connection      = **** {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] database.sqlite_synchronous    = True {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] database.synchronous_reader    = True {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] database.use_db_reconnect      = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_tracing.insecure = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] profiler.connection_string     = messaging:// {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] profiler.enabled               = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] profiler.es_doc_type           = notification {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] profiler.es_scroll_size        = 10000 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] profiler.es_scroll_time        = 2m {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] profiler.filter_error_trace    = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] profiler.hmac_keys             = **** {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] profiler.sentinel_service_name = mymaster {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] profiler.socket_timeout        = 0.1 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] profiler.trace_requests        = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] profiler.trace_sqlalchemy      = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] profiler_jaeger.process_tags   = {} {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] profiler_jaeger.service_name_prefix = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] profiler_otlp.service_name_prefix = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_policy.enforce_new_defaults = True {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_policy.policy_default_rule = default {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] privsep_osbrick.group          = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] privsep_osbrick.helper_command = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] privsep_osbrick.user           = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cinder_sys_admin.group         = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cinder_sys_admin.helper_command = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] cinder_sys_admin.user          = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] service_user.auth_section      = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] service_user.auth_type         = password {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] service_user.cafile            = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] service_user.certfile          = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] service_user.collect_timing    = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] service_user.insecure          = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] service_user.keyfile           = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] service_user.send_service_user_token = True {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] service_user.split_loggers     = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] service_user.timeout           = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] service_user.tls_ciphers       = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] service_user.tls_min_version   = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] glance.auth_section            = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] glance.auth_type               = password {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] glance.certfile                = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] glance.collect_timing          = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] glance.insecure                = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] glance.keyfile                 = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] glance.region_name             = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] glance.split_loggers           = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] glance.timeout                 = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] glance.tls_ciphers             = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] glance.tls_min_version         = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.backend_availability_zone = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.chap_password = **** {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.chap_username =  {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.disk_geometry = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.driver_client_cert = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.driver_client_cert_key = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.driver_data_namespace = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.driver_use_ssl = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.extra_capabilities = {} {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.filter_function = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.goodness_function = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.iscsi_target_flags =  {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.iscsi_write_cache = on {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.iser_ip_address = 192.168.122.7 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.iser_port     = 3260 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.lvm_share_target = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.lvm_type      = auto {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.num_shell_tries = 3 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.replication_device = **** {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.report_discard_supported = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.reserved_percentage = 0 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.target_helper = tgtadm {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.target_ip_address = 192.168.122.7 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.target_port   = 3260 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.target_protocol = iscsi {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.trace_flags   = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.unique_fqdn_network = True {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.use_chap_auth = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.volume_backend_name = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.volume_clear  = zero {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.volume_clear_ionice = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.volume_clear_size = 0 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_reports.file_event_handler = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_reports.log_dir           = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.backend_host       = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.chap_password      = **** {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.chap_username      = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.disk_geometry      = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.driver_client_cert = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.extra_capabilities = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.filter_function    = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.goodness_function  = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.iser_helper        = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.iser_port          = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.lvm_type           = auto {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.replication_device = **** {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.report_discard_supported = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.reserved_percentage = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.scst_target_driver = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.storage_protocol   = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.target_ip_address  = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.target_port        = 3260 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.trace_flags        = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.volume_clear       = zero {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] lvmdriver-1.volumes_dir        = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_notifications.driver = [] {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_notifications.retry = -1 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] key_manager.fixed_key          = **** {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] barbican.barbican_api_version  = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] barbican.barbican_endpoint     = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] barbican.barbican_endpoint_type = public {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] barbican.barbican_region_name  = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] barbican.cafile                = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] barbican.certfile              = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] barbican.collect_timing        = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] barbican.insecure              = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] barbican.keyfile               = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] barbican.number_of_retries     = 60 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] barbican.retry_delay           = 1 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] barbican.send_service_user_token = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] barbican.split_loggers         = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] barbican.timeout               = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] barbican.tls_ciphers           = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] barbican.tls_min_version       = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] barbican.verify_ssl            = True {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] barbican.verify_ssl_path       = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] barbican_service_user.auth_section = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] barbican_service_user.auth_type = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] barbican_service_user.cafile   = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] barbican_service_user.certfile = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] barbican_service_user.collect_timing = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] barbican_service_user.insecure = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] barbican_service_user.keyfile  = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] barbican_service_user.split_loggers = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] barbican_service_user.timeout  = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] barbican_service_user.tls_ciphers = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] barbican_service_user.tls_min_version = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] vault.approle_role_id          = **** {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] vault.approle_secret_id        = **** {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] vault.auth_method              = approle {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] vault.auth_path                = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] vault.kv_mountpoint            = secret {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] vault.kv_path                  = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] vault.kv_version               = 2 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] vault.namespace                = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] vault.root_token_id            = **** {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] vault.ssl_ca_crt_file          = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] vault.timeout                  = 60.0 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] vault.token_file               = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] vault.token_role               = None {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] vault.use_ssl                  = False {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:19:55 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] ******************************************************************************** {{(pid=75407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 05 09:19:55 devstack sudo[75563]: pam_unix(sudo:session): session closed for user root
Nov 05 09:19:55 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.389s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:19:55 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:19:55 devstack sudo[75711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 09:19:55 devstack sudo[75711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:19:55 devstack sudo[75711]: pam_unix(sudo:session): session closed for user root
Nov 05 09:19:55 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.309s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:19:55 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 09:19:55 devstack cinder-volume[75556]: INFO cinder.brick.local_dev.lvm [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Nov 05 09:19:55 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:19:56 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:19:56 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:19:56 devstack sudo[75813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 09:19:56 devstack sudo[75813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:19:56 devstack sudo[75813]: pam_unix(sudo:session): session closed for user root
Nov 05 09:19:56 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:19:56 devstack cinder-volume[75556]: DEBUG cinder.brick.local_dev.lvm [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75556) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Nov 05 09:19:56 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:19:56 devstack sudo[75897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 09:19:56 devstack sudo[75897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:19:56 devstack sudo[75897]: pam_unix(sudo:session): session closed for user root
Nov 05 09:19:56 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.557s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:19:56 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:19:56 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:19:56 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:19:56 devstack sudo[76085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 09:19:56 devstack sudo[76085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:19:57 devstack sudo[76085]: pam_unix(sudo:session): session closed for user root
Nov 05 09:19:57 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.362s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:19:57 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:19:57 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:19:57 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:19:57 devstack sudo[76171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Nov 05 09:19:57 devstack sudo[76171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:19:57 devstack sudo[76171]: pam_unix(sudo:session): session closed for user root
Nov 05 09:19:57 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.318s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:19:57 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:19:57 devstack sudo[76192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 09:19:57 devstack sudo[76192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:19:57 devstack sudo[76192]: pam_unix(sudo:session): session closed for user root
Nov 05 09:19:57 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.342s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:19:57 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:19:57 devstack sudo[76259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 09:19:57 devstack sudo[76259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:19:58 devstack sudo[76259]: pam_unix(sudo:session): session closed for user root
Nov 05 09:19:58 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:19:58 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:19:58 devstack sudo[76269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 09:19:58 devstack sudo[76269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:19:58 devstack sudo[76269]: pam_unix(sudo:session): session closed for user root
Nov 05 09:19:58 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.320s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:19:58 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:19:58 devstack sudo[76352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 09:19:58 devstack sudo[76352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:19:58 devstack sudo[76352]: pam_unix(sudo:session): session closed for user root
Nov 05 09:19:58 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:19:58 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:19:58 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:19:58 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:19:58 devstack sudo[76356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 09:19:58 devstack sudo[76356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:19:59 devstack sudo[76356]: pam_unix(sudo:session): session closed for user root
Nov 05 09:19:59 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.309s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:19:59 devstack cinder-volume[75556]: INFO cinder.volume.drivers.lvm [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Enabling LVM thin provisioning by default because a thin pool exists.
Nov 05 09:19:59 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:19:59 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:19:59 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:19:59 devstack sudo[76360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 09:19:59 devstack sudo[76360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:19:59 devstack sudo[76360]: pam_unix(sudo:session): session closed for user root
Nov 05 09:19:59 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.291s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:19:59 devstack cinder-volume[75556]: DEBUG cinder.volume.drivers.lvm [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Updating volume stats {{(pid=75556) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 09:19:59 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:19:59 devstack sudo[76363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 09:19:59 devstack sudo[76363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:19:59 devstack sudo[76363]: pam_unix(sudo:session): session closed for user root
Nov 05 09:19:59 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:19:59 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:19:59 devstack sudo[76372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 09:19:59 devstack sudo[76372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:20:00 devstack sudo[76372]: pam_unix(sudo:session): session closed for user root
Nov 05 09:20:00 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:20:00 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:20:00 devstack sudo[76375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 09:20:00 devstack sudo[76375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:20:00 devstack sudo[76375]: pam_unix(sudo:session): session closed for user root
Nov 05 09:20:00 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.314s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:20:00 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:20:00 devstack sudo[76378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 09:20:00 devstack sudo[76378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:20:00 devstack sudo[76378]: pam_unix(sudo:session): session closed for user root
Nov 05 09:20:00 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.310s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:20:00 devstack cinder-volume[75556]: INFO cinder.volume.driver [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Driver hasn't implemented _init_vendor_properties()
Nov 05 09:20:00 devstack cinder-volume[75556]: DEBUG cinder.volume.driver [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75556) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 05 09:20:00 devstack cinder-volume[75556]: DEBUG oslo_db.sqlalchemy.engines [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75556) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 09:20:00 devstack cinder-volume[75556]: DEBUG dbcounter [-] [75556] Writer thread running {{(pid=75556) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 09:20:00 devstack cinder-volume[75556]: DEBUG cinder.db.api [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Building query based on filter {{(pid=75556) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}}
Nov 05 09:20:00 devstack cinder-volume[75556]: DEBUG cinder.image.image_utils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75556) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 05 09:20:00 devstack cinder-volume[75556]: INFO cinder.keymgr.migration [None req-575b7d5e-f979-4d5d-a923-f062a7fa6826 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 05 09:20:00 devstack cinder-volume[75556]: DEBUG cinder.volume.drivers.lvm [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Updating volume stats {{(pid=75556) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 09:20:00 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:20:00 devstack sudo[76383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 09:20:00 devstack sudo[76383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:20:01 devstack sudo[76383]: pam_unix(sudo:session): session closed for user root
Nov 05 09:20:01 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.354s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:20:01 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:20:01 devstack sudo[76389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 09:20:01 devstack sudo[76389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:20:01 devstack sudo[76389]: pam_unix(sudo:session): session closed for user root
Nov 05 09:20:01 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:20:01 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:20:01 devstack sudo[76392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 09:20:01 devstack sudo[76392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:20:01 devstack sudo[76392]: pam_unix(sudo:session): session closed for user root
Nov 05 09:20:01 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.329s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:20:01 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:20:01 devstack sudo[76396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 09:20:01 devstack sudo[76396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:20:02 devstack sudo[76396]: pam_unix(sudo:session): session closed for user root
Nov 05 09:20:02 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.361s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:20:02 devstack cinder-volume[75556]: DEBUG cinder.manager [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Notifying Schedulers of capabilities ... {{(pid=75556) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:20:02 devstack cinder-volume[75556]: INFO cinder.volume.manager [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Driver initialization completed successfully.
Nov 05 09:20:02 devstack cinder-volume[75556]: INFO cinder.manager [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Initiating service 2 cleanup
Nov 05 09:20:02 devstack cinder-volume[75556]: INFO cinder.manager [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Service 2 cleanup completed.
Nov 05 09:20:02 devstack cinder-volume[75556]: DEBUG cinder.service [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Creating RPC server for service cinder-volume {{(pid=75556) start /opt/stack/cinder/cinder/service.py:231}}
Nov 05 09:20:02 devstack cinder-volume[75556]: DEBUG cinder.service [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75556) start /opt/stack/cinder/cinder/service.py:237}}
Nov 05 09:20:02 devstack cinder-volume[75556]: INFO cinder.volume.manager [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Nov 05 09:20:02 devstack cinder-volume[75556]: DEBUG cinder.volume.drivers.lvm [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Updating volume stats {{(pid=75556) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 09:20:02 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:20:02 devstack sudo[76402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 09:20:02 devstack sudo[76402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:20:02 devstack sudo[76402]: pam_unix(sudo:session): session closed for user root
Nov 05 09:20:02 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:20:02 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:20:02 devstack sudo[76405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 09:20:02 devstack sudo[76405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:20:02 devstack sudo[76405]: pam_unix(sudo:session): session closed for user root
Nov 05 09:20:02 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:20:02 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:20:02 devstack sudo[76411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 09:20:02 devstack sudo[76411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:20:03 devstack sudo[76411]: pam_unix(sudo:session): session closed for user root
Nov 05 09:20:03 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:20:03 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:20:03 devstack sudo[76414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 09:20:03 devstack sudo[76414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:20:03 devstack sudo[76414]: pam_unix(sudo:session): session closed for user root
Nov 05 09:20:03 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:20:03 devstack cinder-volume[75556]: INFO cinder.volume.manager [None req-fd2e4471-8c3d-4aec-b16e-b9ba19b8ba3d None None] Driver post RPC initialization completed successfully.
Nov 05 09:20:05 devstack cinder-volume[75407]: DEBUG dbcounter [-] [75407] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:20:13 devstack cinder-volume[75556]: DEBUG dbcounter [-] [75556] Writing DB stats cinder:SELECT=4 {{(pid=75556) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:20:13 devstack cinder-volume[75556]: DEBUG dbcounter [-] [75556] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75556) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:20:36 devstack cinder-volume[75556]: DEBUG oslo_service.periodic_task [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] Running periodic task VolumeManager._thread_info {{(pid=75556) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:20:36 devstack cinder-volume[75556]: DEBUG cinder.volume.manager [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] thread count: 6 {{(pid=75556) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:20:36 devstack cinder-volume[75556]: DEBUG cinder.volume.manager [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] thread info: [<_MainThread(MainThread, started 135131048370304)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135130935042752)>, <Thread(Thread-3 (stat_writer), started daemon 135130947810560)>, <Thread(Rabbit-heartbeat, started daemon 135130932941824)>, <Thread(Thread-5 (_runner), started daemon 135130932976640)>, <Thread(Thread-7 (_runner), started daemon 135130931012864)>] {{(pid=75556) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:21:36 devstack cinder-volume[75556]: DEBUG oslo_service.periodic_task [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75556) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:21:36 devstack cinder-volume[75556]: DEBUG cinder.volume.drivers.lvm [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] Updating volume stats {{(pid=75556) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 09:21:36 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:21:36 devstack sudo[81495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 09:21:36 devstack sudo[81495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:21:36 devstack sudo[81495]: pam_unix(sudo:session): session closed for user root
Nov 05 09:21:36 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.304s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:21:36 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:21:36 devstack sudo[81502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 09:21:36 devstack sudo[81502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:21:37 devstack sudo[81502]: pam_unix(sudo:session): session closed for user root
Nov 05 09:21:37 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:21:37 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:21:37 devstack sudo[81508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 09:21:37 devstack sudo[81508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:21:37 devstack sudo[81508]: pam_unix(sudo:session): session closed for user root
Nov 05 09:21:37 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.282s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:21:37 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:21:37 devstack sudo[81511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 09:21:37 devstack sudo[81511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:21:37 devstack sudo[81511]: pam_unix(sudo:session): session closed for user root
Nov 05 09:21:37 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:21:37 devstack cinder-volume[75556]: DEBUG cinder.manager [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] Notifying Schedulers of capabilities ... {{(pid=75556) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:21:37 devstack cinder-volume[75556]: DEBUG oslo_service.periodic_task [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] Running periodic task VolumeManager._thread_info {{(pid=75556) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:21:37 devstack cinder-volume[75556]: DEBUG cinder.volume.manager [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] thread count: 6 {{(pid=75556) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:21:37 devstack cinder-volume[75556]: DEBUG cinder.volume.manager [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] thread info: [<_MainThread(MainThread, started 135131048370304)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135130935042752)>, <Thread(Thread-3 (stat_writer), started daemon 135130947810560)>, <Thread(Rabbit-heartbeat, started daemon 135130932941824)>, <Thread(Thread-5 (_runner), started daemon 135130932976640)>, <Thread(Thread-7 (_runner), started daemon 135130931012864)>] {{(pid=75556) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:22:13 devstack cinder-volume[75556]: DEBUG dbcounter [-] [75556] Writing DB stats cinder:SELECT=1 {{(pid=75556) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:22:13 devstack cinder-volume[75556]: DEBUG dbcounter [-] [75556] Writing DB stats cinder:UPDATE=1 {{(pid=75556) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:22:36 devstack cinder-volume[75556]: DEBUG oslo_service.periodic_task [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75556) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:22:36 devstack cinder-volume[75556]: DEBUG cinder.volume.drivers.lvm [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] Updating volume stats {{(pid=75556) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 09:22:36 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:22:36 devstack sudo[82996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 09:22:36 devstack sudo[82996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:22:36 devstack sudo[82996]: pam_unix(sudo:session): session closed for user root
Nov 05 09:22:36 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.313s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:22:36 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:22:36 devstack sudo[83016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 09:22:36 devstack sudo[83016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:22:37 devstack sudo[83016]: pam_unix(sudo:session): session closed for user root
Nov 05 09:22:37 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.340s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:22:37 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:22:37 devstack sudo[83025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 09:22:37 devstack sudo[83025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:22:37 devstack sudo[83025]: pam_unix(sudo:session): session closed for user root
Nov 05 09:22:37 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:22:37 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:22:37 devstack sudo[83050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 09:22:37 devstack sudo[83050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:22:37 devstack sudo[83050]: pam_unix(sudo:session): session closed for user root
Nov 05 09:22:37 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:22:37 devstack cinder-volume[75556]: DEBUG cinder.manager [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] Notifying Schedulers of capabilities ... {{(pid=75556) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:22:37 devstack cinder-volume[75556]: DEBUG oslo_service.periodic_task [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] Running periodic task VolumeManager._thread_info {{(pid=75556) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:22:37 devstack cinder-volume[75556]: DEBUG cinder.volume.manager [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] thread count: 6 {{(pid=75556) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:22:37 devstack cinder-volume[75556]: DEBUG cinder.volume.manager [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] thread info: [<_MainThread(MainThread, started 135131048370304)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135130935042752)>, <Thread(Thread-3 (stat_writer), started daemon 135130947810560)>, <Thread(Rabbit-heartbeat, started daemon 135130932941824)>, <Thread(Thread-5 (_runner), started daemon 135130932976640)>, <Thread(Thread-7 (_runner), started daemon 135130931012864)>] {{(pid=75556) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:23:36 devstack cinder-volume[75556]: DEBUG oslo_service.periodic_task [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75556) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:23:36 devstack cinder-volume[75556]: DEBUG cinder.volume.drivers.lvm [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] Updating volume stats {{(pid=75556) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 09:23:36 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:23:36 devstack sudo[84515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 09:23:36 devstack sudo[84515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:23:36 devstack sudo[84515]: pam_unix(sudo:session): session closed for user root
Nov 05 09:23:36 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:23:36 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:23:36 devstack sudo[84541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 09:23:36 devstack sudo[84541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:23:37 devstack sudo[84541]: pam_unix(sudo:session): session closed for user root
Nov 05 09:23:37 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:23:37 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:23:37 devstack sudo[84544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 09:23:37 devstack sudo[84544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:23:37 devstack sudo[84544]: pam_unix(sudo:session): session closed for user root
Nov 05 09:23:37 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.307s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:23:37 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:23:37 devstack sudo[84550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 09:23:37 devstack sudo[84550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:23:37 devstack sudo[84550]: pam_unix(sudo:session): session closed for user root
Nov 05 09:23:37 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.320s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:23:37 devstack cinder-volume[75556]: DEBUG cinder.manager [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] Notifying Schedulers of capabilities ... {{(pid=75556) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:24:13 devstack cinder-volume[75556]: DEBUG dbcounter [-] [75556] Writing DB stats cinder:SELECT=1 {{(pid=75556) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:24:13 devstack cinder-volume[75556]: DEBUG dbcounter [-] [75556] Writing DB stats cinder:UPDATE=1 {{(pid=75556) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:24:28 devstack cinder-volume[75407]: INFO oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] Caught SIGTERM, stopping children
Nov 05 09:24:28 devstack cinder-volume[75407]: DEBUG oslo_concurrency.lockutils [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] Acquiring lock "singleton_lock" {{(pid=75407) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 09:24:28 devstack cinder-volume[75407]: DEBUG oslo_concurrency.lockutils [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] Acquired lock "singleton_lock" {{(pid=75407) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 09:24:28 devstack cinder-volume[75407]: DEBUG oslo_concurrency.lockutils [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] Releasing lock "singleton_lock" {{(pid=75407) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 09:24:28 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] Stop services. {{(pid=75407) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 05 09:24:28 devstack cinder-volume[75407]: DEBUG oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] Killing children. {{(pid=75407) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 05 09:24:28 devstack cinder-volume[75407]: INFO oslo_service.backend._eventlet.service [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] Waiting on 1 children to exit
Nov 05 09:24:33 devstack cinder-volume[75556]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Nov 05 09:24:34 devstack cinder-volume[85621]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 05 09:24:34 devstack cinder-volume[85621]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 09:24:34 devstack cinder-volume[85621]: we strongly recommend against using it for new projects.
Nov 05 09:24:34 devstack cinder-volume[85621]: If you are already using Eventlet, we recommend migrating to a different
Nov 05 09:24:34 devstack cinder-volume[85621]: framework.  For more detail see
Nov 05 09:24:34 devstack cinder-volume[85621]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 09:24:34 devstack cinder-volume[85621]:   import eventlet  # noqa
Nov 05 09:24:36 devstack cinder-volume[85621]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85621) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 09:24:36 devstack cinder-volume[85621]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85621) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 09:24:36 devstack cinder-volume[85621]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85621) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 09:24:36 devstack cinder-volume[75556]: DEBUG oslo_service.periodic_task [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75556) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:24:36 devstack cinder-volume[75556]: DEBUG cinder.volume.drivers.lvm [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] Updating volume stats {{(pid=75556) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 09:24:36 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:24:36 devstack sudo[85740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 09:24:36 devstack sudo[85740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:24:36 devstack sudo[85740]: pam_unix(sudo:session): session closed for user root
Nov 05 09:24:36 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:24:36 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:24:36 devstack sudo[85765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 09:24:36 devstack sudo[85765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:24:37 devstack cinder-volume[85621]: INFO dbcounter [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] Registered counter for database cinder
Nov 05 09:24:37 devstack cinder-volume[85621]: DEBUG oslo_db.sqlalchemy.engines [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85621) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 09:24:37 devstack sudo[85765]: pam_unix(sudo:session): session closed for user root
Nov 05 09:24:37 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.493s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:24:37 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:24:37 devstack sudo[85768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 09:24:37 devstack sudo[85768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:24:37 devstack cinder-volume[85621]: DEBUG dbcounter [-] [85621] Writer thread running {{(pid=85621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 09:24:37 devstack cinder-volume[85621]: INFO cinder.rpc [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 05 09:24:37 devstack cinder-volume[85621]: INFO cinder.rpc [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 05 09:24:37 devstack cinder-volume[85621]: DEBUG oslo_db.sqlalchemy.engines [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85621) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 09:24:37 devstack sudo[85768]: pam_unix(sudo:session): session closed for user root
Nov 05 09:24:37 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.469s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:24:37 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:24:37 devstack cinder-volume[85621]: INFO cinder.volume.manager [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] Determined volume DB was empty at startup.
Nov 05 09:24:37 devstack cinder-volume[85621]: DEBUG cinder.volume.manager [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85621) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 05 09:24:37 devstack cinder-volume[85621]: INFO cinder.volume.manager [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 05 09:24:37 devstack cinder-volume[85621]: WARNING stevedore.named [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 09:24:37 devstack cinder-volume[85621]: WARNING castellan.key_manager [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 09:24:37 devstack cinder-volume[85621]: WARNING cinder.keymgr.conf_key_mgr [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 09:24:37 devstack sudo[85852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 09:24:37 devstack sudo[85852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:24:37 devstack cinder-volume[85621]: INFO cinder.volume.manager [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_db.sqlalchemy.engines [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85621) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 09:24:38 devstack cinder-volume[85621]: INFO oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] Starting 1 workers
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] Started child 85858 {{(pid=85621) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] Full set of CONF: {{(pid=85621) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] ******************************************************************************** {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] Configuration options gathered from: {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] ================================================================================ {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 05 09:24:38 devstack cinder-volume[85858]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] allow_availability_zone_fallback = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] allow_compression_on_image_upload = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] allowed_direct_url_schemes     = [] {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] api_rate_limit                 = True {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] auth_strategy                  = keystone {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_availability_zone      = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_host                   = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_name                   = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_stats_polling_interval = 60 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backup_api_class               = cinder.backup.api.API {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backup_name_template           = backup-%s {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backup_use_same_host           = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backup_use_temp_snapshot       = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] chap_password                  = **** {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] chap_username                  =  {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cinder_internal_tenant_project_id = 3a3087dd1fca4b0f8ad751e6a8643056 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cinder_internal_tenant_user_id = 43fb5a6c7fa64c4fbd8151fc0bd16c76 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cluster                        = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] compression_format             = gzip {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] compute_api_class              = cinder.compute.nova.API {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] config_dir                     = [] {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] config_source                  = [] {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] control_exchange               = openstack {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] debug                          = True {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] default_availability_zone      = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] default_group_type             = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] default_volume_type            = QuobyteHD {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] disk_geometry                  = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] driver_client_cert             = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] driver_client_cert_key         = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] driver_data_namespace          = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] driver_ssl_cert_path           = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] driver_ssl_cert_verify         = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] driver_use_ssl                 = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] enable_new_services            = True {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] enable_unsupported_driver      = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] enabled_backends               = ['QuobyteHD'] {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] enforce_multipath_for_image_xfer = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] filter_function                = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] glance_api_insecure            = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] glance_api_servers             = ['http://192.168.122.7/image'] {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] glance_api_ssl_compression     = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] glance_ca_certificates_file    = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] glance_catalog_info            = image:glance:publicURL {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] glance_certfile                = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] glance_keyfile                 = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] glance_num_retries             = 3 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] glance_request_timeout         = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] goodness_function              = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] graceful_shutdown_timeout      = 5 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] group_api_class                = cinder.group.api.API {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] host                           = devstack {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] image_compress_on_upload       = True {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] image_conversion_address_space_limit = 1 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] image_conversion_cpu_limit     = 60 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] image_conversion_disable       = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] image_introspection_address_space_limit = 1 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] image_introspection_cpu_limit  = 60 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] image_upload_use_cinder_backend = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] image_upload_use_internal_tenant = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] image_volume_cache_enabled     = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] image_volume_cache_max_count   = 0 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] image_volume_cache_max_size_gb = 0 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] init_host_max_objects_retrieval = 0 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85858]: INFO cinder.volume.manager [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 05 09:24:38 devstack cinder-volume[85858]: DEBUG cinder.volume.drivers.remotefs [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85858) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] instance_format                = [instance: %(uuid)s]  {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] iscsi_target_flags             =  {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] iscsi_write_cache              = on {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] iser_helper                    = tgtadm {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] iser_ip_address                = 192.168.122.7 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] iser_port                      = 3260 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] log_color                      = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] log_config_append              = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] log_dir                        = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] log_file                       = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] log_options                    = True {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] log_rotate_interval            = 1 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] log_rotate_interval_type       = days {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] log_rotation_type              = none {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] max_age                        = 0 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] max_logfile_count              = 30 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] max_logfile_size_mb            = 200 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] max_over_subscription_ratio    = 20.0 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] message_reap_interval          = 86400 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] message_ttl                    = 2592000 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] migration_create_volume_timeout_secs = 300 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] monkey_patch                   = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] monkey_patch_modules           = [] {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] my_ip                          = 192.168.122.7 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] no_snapshot_gb_quota           = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] num_iser_scan_tries            = 3 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] num_shell_tries                = 3 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] num_volume_device_scan_tries   = 3 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] nvmeof_conn_info_version       = 1 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] nvmet_ns_id                    = 10 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] nvmet_port_id                  = 1 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] osapi_max_limit                = 1000 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] osapi_volume_ext_list          = [] {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] osapi_volume_listen_port       = 8776 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] osapi_volume_use_ssl           = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] osapi_volume_workers           = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] per_volume_size_limit          = -1 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] periodic_fuzzy_delay           = 60 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] periodic_interval              = 60 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] public_endpoint                = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] publish_errors                 = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] quota_backup_gigabytes         = 1000 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] quota_backups                  = 10 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] quota_gigabytes                = 1000 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] quota_groups                   = 10 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] quota_snapshots                = 10 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] quota_volumes                  = 10 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] rate_limit_burst               = 0 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] rate_limit_except_level        = CRITICAL {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] rate_limit_interval            = 0 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] reinit_driver_count            = 3 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] replication_device             = **** {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] report_discard_supported       = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] report_interval                = 120 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] reservation_clean_interval     = 86400 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] reservation_expire             = 86400 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] reserved_image_namespaces      = [] {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] reserved_percentage            = 0 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] rpc_response_timeout           = 120 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] run_external_periodic_tasks    = True {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] scst_target_driver             = iscsi {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] scst_target_iqn_name           = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] service_down_time              = 720 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] shell_completion               = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] snapshot_name_template         = snapshot-%s {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] split_loggers                  = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] state_path                     = /opt/stack/data/cinder {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] storage_availability_zone      = nova {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] storage_protocol               = iSCSI {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] syslog_log_facility            = LOG_USER {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] target_helper                  = lioadm {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] target_ip_address              = 192.168.122.7 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] target_port                    = 3260 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] target_protocol                = iscsi {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] target_secondary_ip_addresses  = [] {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] trace_flags                    = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] transport_url                  = **** {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] until_refresh                  = 0 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] use_chap_auth                  = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] use_default_quota_class        = True {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] use_journal                    = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] use_json                       = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] use_multipath_for_image_xfer   = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] use_stderr                     = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] use_syslog                     = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] verify_glance_signatures       = enabled {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] volume_api_class               = cinder.volume.api.API {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] volume_backend_name            = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] volume_clear                   = zero {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] volume_clear_ionice            = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] volume_clear_size              = 0 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] volume_copy_bps_limit          = 0 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] volume_dd_blocksize            = 1M {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] volume_name_template           = volume-%s {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] volume_service_inithost_offload = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] volume_usage_audit_period      = month {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] zoning_mode                    = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_concurrency.disable_process_locking = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.auth_section = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.auth_type   = password {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.auth_version = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.cache       = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.certfile    = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.include_service_catalog = True {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.insecure    = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.interface   = public {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.keyfile     = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.memcache_password = **** {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.420s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:24:38 devstack cinder-volume[75556]: DEBUG cinder.manager [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] Notifying Schedulers of capabilities ... {{(pid=75556) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:24:38 devstack sudo[85852]: pam_unix(sudo:session): session closed for user root
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.memcache_username = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.region_name = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.service_type = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.7/identity {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.backend                  = dogpile.cache.null {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[75556]: DEBUG oslo_service.periodic_task [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] Running periodic task VolumeManager._thread_info {{(pid=75556) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:24:38 devstack cinder-volume[75556]: DEBUG cinder.volume.manager [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] thread count: 5 {{(pid=75556) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:24:38 devstack cinder-volume[75556]: DEBUG cinder.volume.manager [None req-fe69bb85-9223-45c9-85f5-9b5c56f4feb0 None None] thread info: [<_MainThread(MainThread, started 135131048370304)>, <Thread(Thread-3 (stat_writer), started daemon 135130947810560)>, <Thread(Rabbit-heartbeat, started daemon 135130932941824)>, <Thread(Thread-4 (_process_in_background), started daemon 135130932387712)>, <Thread(Thread-6 (_process_in_background), started daemon 135130931013056)>] {{(pid=75556) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.backend_argument         = **** {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.backend_expiration_time  = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.config_prefix            = cache.oslo {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.debug_cache_backend      = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.enable_retry_client      = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.enable_socket_keepalive  = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.enabled                  = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[75556]: DEBUG oslo_concurrency.lockutils [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] Acquiring lock "singleton_lock" {{(pid=75556) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 09:24:38 devstack cinder-volume[75556]: DEBUG oslo_concurrency.lockutils [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] Acquired lock "singleton_lock" {{(pid=75556) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 09:24:38 devstack cinder-volume[75556]: DEBUG oslo_concurrency.lockutils [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] Releasing lock "singleton_lock" {{(pid=75556) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.expiration_time          = 600 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.hashclient_retry_attempts = 2 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85858]: DEBUG cinder.volume.drivers.quobyte [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85858) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 05 09:24:38 devstack cinder-volume[85858]: WARNING cinder.volume.drivers.quobyte [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 05 09:24:38 devstack cinder-volume[85858]: WARNING cinder.volume.drivers.quobyte [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.memcache_dead_retry      = 300 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85858]: DEBUG oslo_concurrency.processutils [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Running cmd (subprocess): mount.quobyte {{(pid=85858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.memcache_pool_maxsize    = 10 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.memcache_sasl_enabled    = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.password                 = **** {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.proxies                  = [] {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.redis_db                 = 0 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.redis_server             = localhost:6379 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.retry_attempts           = 2 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.retry_delay              = 0.0 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.socket_keepalive_count   = 1 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.socket_keepalive_idle    = 1 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[75556]: WARNING amqp [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.socket_keepalive_interval = 1 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.socket_timeout           = 1.0 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.tls_allowed_ciphers      = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.tls_cafile               = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.tls_certfile             = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.tls_enabled              = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.tls_keyfile              = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cache.username                 = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] coordination.backend_url       = **** {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] database.asyncio_connection    = **** {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] database.asyncio_slave_connection = **** {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] database.backend               = sqlalchemy {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] database.connection            = **** {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] database.connection_debug      = 0 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] database.connection_parameters =  {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] database.connection_recycle_time = 3600 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] database.connection_trace      = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] database.db_inc_retry_interval = True {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] database.db_max_retries        = 20 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] database.db_max_retry_interval = 10 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] database.db_retry_interval     = 1 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] database.max_overflow          = 50 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] database.max_pool_size         = 5 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] database.max_retries           = 10 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] database.mysql_wsrep_sync_wait = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] database.pool_timeout          = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] database.retry_interval        = 10 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] database.slave_connection      = **** {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] database.sqlite_synchronous    = True {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] database.synchronous_reader    = True {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] database.use_db_reconnect      = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_tracing.insecure = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] profiler.connection_string     = messaging:// {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] profiler.enabled               = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] profiler.es_doc_type           = notification {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] profiler.es_scroll_size        = 10000 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] profiler.es_scroll_time        = 2m {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] profiler.filter_error_trace    = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] profiler.hmac_keys             = **** {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] profiler.sentinel_service_name = mymaster {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] profiler.socket_timeout        = 0.1 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] profiler.trace_requests        = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] profiler.trace_sqlalchemy      = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] profiler_jaeger.process_tags   = {} {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] profiler_jaeger.service_name_prefix = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] profiler_otlp.service_name_prefix = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_policy.enforce_new_defaults = True {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_policy.policy_default_rule = default {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_policy.policy_file        = policy.yaml {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[75556]: WARNING amqp [None req-b1bdd37c-5331-49cc-b5cc-ed8b0a0e5c78 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] privsep_osbrick.group          = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] privsep_osbrick.helper_command = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] privsep_osbrick.user           = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cinder_sys_admin.group         = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cinder_sys_admin.helper_command = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] cinder_sys_admin.user          = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] service_user.auth_section      = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] service_user.auth_type         = password {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] service_user.cafile            = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] service_user.certfile          = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] service_user.collect_timing    = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] service_user.insecure          = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] service_user.keyfile           = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] service_user.send_service_user_token = True {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] service_user.split_loggers     = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] service_user.timeout           = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] service_user.tls_ciphers       = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] service_user.tls_min_version   = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] glance.auth_section            = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] glance.auth_type               = password {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] glance.certfile                = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85858]: DEBUG oslo_concurrency.processutils [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] CMD "mount.quobyte" returned: 1 in 0.076s {{(pid=85858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:24:38 devstack cinder-volume[85858]: DEBUG oslo_concurrency.lockutils [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85858) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:24:38 devstack cinder-volume[85858]: DEBUG oslo_concurrency.lockutils [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85858) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:24:38 devstack cinder-volume[85858]: DEBUG cinder.volume.drivers.quobyte [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=85858) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:24:38 devstack cinder-volume[85858]: INFO cinder.volume.drivers.quobyte [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 ...
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] glance.collect_timing          = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85858]: DEBUG oslo_concurrency.processutils [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d -c /etc/quobyte/client-cinder.cfg {{(pid=85858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] glance.insecure                = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] glance.keyfile                 = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] glance.region_name             = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] glance.split_loggers           = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] glance.timeout                 = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] glance.tls_ciphers             = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] glance.tls_min_version         = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.backend_availability_zone = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.chap_password = **** {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.chap_username =  {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack sudo[85862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d -c /etc/quobyte/client-cinder.cfg
Nov 05 09:24:38 devstack sudo[85862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.disk_geometry = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.driver_client_cert = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.driver_client_cert_key = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.driver_data_namespace = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.driver_use_ssl = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.extra_capabilities = {} {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.filter_function = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.goodness_function = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.iscsi_target_flags =  {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.iscsi_write_cache = on {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.iser_helper   = tgtadm {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.iser_ip_address = 192.168.122.7 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.iser_port     = 3260 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.nas_host      =  {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.nas_login     = admin {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.nas_mount_options = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.nas_password  = **** {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.nas_private_key =  {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.nas_share_path =  {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.num_shell_tries = 3 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.quobyte_volume_url = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.replication_device = **** {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.report_discard_supported = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.reserved_percentage = 0 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.target_helper = tgtadm {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.target_ip_address = 192.168.122.7 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.target_port   = 3260 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.target_protocol = iscsi {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.trace_flags   = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.unique_fqdn_network = True {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.use_chap_auth = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.volume_backend_name = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.volume_clear  = zero {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.volume_clear_ionice = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.volume_clear_size = 0 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_reports.file_event_handler = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_reports.log_dir           = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.backend_availability_zone = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.backend_host         = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.chap_password        = **** {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.chap_username        = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.chiscsi_conf         = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.disk_geometry        = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.driver_client_cert   = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.driver_data_namespace = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.driver_use_ssl       = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.extra_capabilities   = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.filter_function      = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.goodness_function    = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.iser_helper          = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.iser_ip_address      = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.iser_port            = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.iser_target_prefix   = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.nas_host             = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.nas_login            = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.nas_mount_options    = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.nas_password         = **** {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.nas_private_key      = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.nas_share_path       = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.nas_ssh_port         = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.num_shell_tries      = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.nvmet_port_id        = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.replication_device   = **** {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.report_discard_supported = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.reserved_percentage  = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.scst_target_driver   = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.storage_protocol     = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.target_helper        = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.target_ip_address    = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.target_port          = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.target_prefix        = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.target_protocol      = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.trace_flags          = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.use_chap_auth        = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.volume_clear         = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.volume_clear_size    = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] QuobyteHD.volumes_dir          = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.ssl      = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_notifications.driver = [] {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_notifications.retry = -1 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] key_manager.fixed_key          = **** {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] barbican.barbican_api_version  = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] barbican.barbican_endpoint     = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] barbican.barbican_endpoint_type = public {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] barbican.barbican_region_name  = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] barbican.cafile                = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] barbican.certfile              = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] barbican.collect_timing        = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] barbican.insecure              = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] barbican.keyfile               = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] barbican.number_of_retries     = 60 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] barbican.retry_delay           = 1 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] barbican.send_service_user_token = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] barbican.split_loggers         = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] barbican.timeout               = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] barbican.tls_ciphers           = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] barbican.tls_min_version       = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] barbican.verify_ssl            = True {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] barbican.verify_ssl_path       = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] barbican_service_user.auth_section = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] barbican_service_user.auth_type = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] barbican_service_user.cafile   = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] barbican_service_user.certfile = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] barbican_service_user.collect_timing = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] barbican_service_user.insecure = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] barbican_service_user.keyfile  = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] barbican_service_user.split_loggers = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] barbican_service_user.timeout  = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] barbican_service_user.tls_ciphers = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] barbican_service_user.tls_min_version = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] vault.approle_role_id          = **** {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] vault.approle_secret_id        = **** {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] vault.auth_method              = approle {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] vault.auth_path                = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] vault.kv_mountpoint            = secret {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] vault.kv_path                  = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] vault.kv_version               = 2 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] vault.namespace                = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] vault.root_token_id            = **** {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] vault.ssl_ca_crt_file          = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] vault.timeout                  = 60.0 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] vault.token_file               = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] vault.token_role               = None {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] vault.use_ssl                  = False {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:38 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] ******************************************************************************** {{(pid=85621) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 05 09:24:38 devstack sudo[85862]: pam_unix(sudo:session): session closed for user root
Nov 05 09:24:38 devstack cinder-volume[85858]: DEBUG oslo_concurrency.processutils [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.504s {{(pid=85858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:24:38 devstack cinder-volume[85858]: INFO cinder.volume.drivers.quobyte [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 succeeded
Nov 05 09:24:38 devstack cinder-volume[85858]: DEBUG cinder.volume.drivers.quobyte [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=85858) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:24:38 devstack cinder-volume[85858]: DEBUG oslo_concurrency.lockutils [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.516s {{(pid=85858) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:24:38 devstack cinder-volume[85858]: DEBUG oslo_concurrency.processutils [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=85858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:24:38 devstack sudo[85965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:24:38 devstack sudo[85965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:24:39 devstack sudo[85965]: pam_unix(sudo:session): session closed for user root
Nov 05 09:24:39 devstack cinder-volume[85858]: DEBUG oslo_concurrency.processutils [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.246s {{(pid=85858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:24:39 devstack cinder-volume[85858]: INFO cinder.volume.driver [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Driver hasn't implemented _init_vendor_properties()
Nov 05 09:24:39 devstack cinder-volume[85858]: DEBUG cinder.volume.driver [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.522720336914, 'free_capacity_gb': 1773.522720336914, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85858) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 05 09:24:39 devstack cinder-volume[85858]: DEBUG oslo_db.sqlalchemy.engines [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85858) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 09:24:39 devstack cinder-volume[85858]: DEBUG dbcounter [-] [85858] Writer thread running {{(pid=85858) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 09:24:39 devstack cinder-volume[85858]: DEBUG cinder.db.api [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Building query based on filter {{(pid=85858) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}}
Nov 05 09:24:39 devstack cinder-volume[85858]: DEBUG cinder.image.image_utils [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85858) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 05 09:24:39 devstack cinder-volume[85858]: INFO cinder.keymgr.migration [None req-c77cd069-5938-4ccf-b019-68fadff863d7 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 05 09:24:39 devstack cinder-volume[85858]: DEBUG oslo_concurrency.lockutils [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85858) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:24:39 devstack cinder-volume[85858]: DEBUG oslo_concurrency.lockutils [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85858) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:24:39 devstack cinder-volume[85858]: DEBUG cinder.volume.drivers.quobyte [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=85858) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:24:39 devstack cinder-volume[85858]: DEBUG cinder.volume.drivers.quobyte [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=85858) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:24:39 devstack cinder-volume[85858]: DEBUG oslo_concurrency.lockutils [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85858) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:24:39 devstack cinder-volume[85858]: DEBUG oslo_concurrency.processutils [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=85858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:24:39 devstack sudo[85971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:24:39 devstack sudo[85971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:24:39 devstack sudo[85971]: pam_unix(sudo:session): session closed for user root
Nov 05 09:24:39 devstack cinder-volume[85858]: DEBUG oslo_concurrency.processutils [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.396s {{(pid=85858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:24:39 devstack cinder-volume[85858]: DEBUG cinder.manager [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Notifying Schedulers of capabilities ... {{(pid=85858) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:24:39 devstack cinder-volume[85858]: INFO cinder.volume.manager [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Driver initialization completed successfully.
Nov 05 09:24:39 devstack cinder-volume[85858]: INFO cinder.manager [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Initiating service 3 cleanup
Nov 05 09:24:39 devstack cinder-volume[85858]: INFO cinder.manager [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Service 3 cleanup completed.
Nov 05 09:24:39 devstack cinder-volume[85858]: DEBUG cinder.service [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Creating RPC server for service cinder-volume {{(pid=85858) start /opt/stack/cinder/cinder/service.py:231}}
Nov 05 09:24:39 devstack cinder-volume[85858]: DEBUG cinder.service [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85858) start /opt/stack/cinder/cinder/service.py:237}}
Nov 05 09:24:39 devstack cinder-volume[85858]: INFO cinder.volume.manager [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 05 09:24:39 devstack cinder-volume[85858]: DEBUG oslo_concurrency.lockutils [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85858) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:24:39 devstack cinder-volume[85858]: DEBUG oslo_concurrency.lockutils [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85858) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:24:39 devstack cinder-volume[85858]: DEBUG cinder.volume.drivers.quobyte [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=85858) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:24:40 devstack cinder-volume[85858]: DEBUG cinder.volume.drivers.quobyte [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=85858) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:24:40 devstack cinder-volume[85858]: DEBUG oslo_concurrency.lockutils [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85858) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:24:40 devstack cinder-volume[85858]: DEBUG oslo_concurrency.processutils [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=85858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:24:40 devstack sudo[86015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:24:40 devstack sudo[86015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:24:40 devstack sudo[86015]: pam_unix(sudo:session): session closed for user root
Nov 05 09:24:40 devstack cinder-volume[85858]: DEBUG oslo_concurrency.processutils [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.624s {{(pid=85858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:24:40 devstack cinder-volume[85858]: INFO cinder.volume.manager [None req-f71f984e-ba66-482c-97a4-1f457051df84 None None] Driver post RPC initialization completed successfully.
Nov 05 09:24:43 devstack cinder-volume[85858]: DEBUG oslo_concurrency.lockutils [None req-b7dae3d6-6626-4124-9cf5-9f74d7082bba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85858) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:24:43 devstack cinder-volume[85858]: DEBUG oslo_concurrency.lockutils [None req-b7dae3d6-6626-4124-9cf5-9f74d7082bba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85858) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:24:43 devstack cinder-volume[85858]: DEBUG cinder.volume.drivers.quobyte [None req-b7dae3d6-6626-4124-9cf5-9f74d7082bba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=85858) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:24:43 devstack cinder-volume[85858]: DEBUG cinder.volume.drivers.quobyte [None req-b7dae3d6-6626-4124-9cf5-9f74d7082bba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=85858) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:24:43 devstack cinder-volume[85858]: DEBUG oslo_concurrency.lockutils [None req-b7dae3d6-6626-4124-9cf5-9f74d7082bba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85858) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:24:43 devstack cinder-volume[85858]: DEBUG oslo_concurrency.processutils [None req-b7dae3d6-6626-4124-9cf5-9f74d7082bba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=85858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:24:43 devstack sudo[86166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:24:43 devstack sudo[86166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:24:44 devstack sudo[86166]: pam_unix(sudo:session): session closed for user root
Nov 05 09:24:44 devstack cinder-volume[85858]: DEBUG oslo_concurrency.processutils [None req-b7dae3d6-6626-4124-9cf5-9f74d7082bba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.231s {{(pid=85858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:24:44 devstack cinder-volume[85858]: DEBUG cinder.manager [None req-b7dae3d6-6626-4124-9cf5-9f74d7082bba None None] Notifying Schedulers of capabilities ... {{(pid=85858) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:24:46 devstack cinder-volume[85621]: INFO oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] Caught SIGTERM, stopping children
Nov 05 09:24:46 devstack cinder-volume[85621]: DEBUG oslo_concurrency.lockutils [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] Acquiring lock "singleton_lock" {{(pid=85621) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 09:24:46 devstack cinder-volume[85621]: DEBUG oslo_concurrency.lockutils [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] Acquired lock "singleton_lock" {{(pid=85621) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 09:24:46 devstack cinder-volume[85621]: DEBUG oslo_concurrency.lockutils [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] Releasing lock "singleton_lock" {{(pid=85621) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 09:24:46 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] Stop services. {{(pid=85621) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 05 09:24:46 devstack cinder-volume[85621]: DEBUG oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] Killing children. {{(pid=85621) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 05 09:24:46 devstack cinder-volume[85621]: INFO oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] Waiting on 1 children to exit
Nov 05 09:24:48 devstack cinder-volume[85858]: DEBUG oslo_concurrency.lockutils [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] Acquiring lock "singleton_lock" {{(pid=85858) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 09:24:48 devstack cinder-volume[85858]: DEBUG oslo_concurrency.lockutils [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] Acquired lock "singleton_lock" {{(pid=85858) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 09:24:48 devstack cinder-volume[85858]: DEBUG oslo_concurrency.lockutils [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] Releasing lock "singleton_lock" {{(pid=85858) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 09:24:48 devstack cinder-volume[85858]: WARNING amqp [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 09:24:48 devstack cinder-volume[85858]: WARNING amqp [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 09:24:48 devstack cinder-volume[85621]: INFO oslo_service.backend._eventlet.service [None req-dc2fd2d8-8dd8-4e19-9034-ae8612064bc1 None None] Child 85858 exited with status 0
Nov 05 09:24:49 devstack cinder-volume[86324]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 05 09:24:49 devstack cinder-volume[86324]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 09:24:49 devstack cinder-volume[86324]: we strongly recommend against using it for new projects.
Nov 05 09:24:49 devstack cinder-volume[86324]: If you are already using Eventlet, we recommend migrating to a different
Nov 05 09:24:49 devstack cinder-volume[86324]: framework.  For more detail see
Nov 05 09:24:49 devstack cinder-volume[86324]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 09:24:49 devstack cinder-volume[86324]:   import eventlet  # noqa
Nov 05 09:24:52 devstack cinder-volume[86324]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86324) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 09:24:52 devstack cinder-volume[86324]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86324) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 09:24:52 devstack cinder-volume[86324]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86324) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 09:24:52 devstack cinder-volume[86324]: INFO dbcounter [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] Registered counter for database cinder
Nov 05 09:24:53 devstack cinder-volume[86324]: DEBUG oslo_db.sqlalchemy.engines [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86324) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 09:24:53 devstack cinder-volume[86324]: DEBUG dbcounter [-] [86324] Writer thread running {{(pid=86324) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 09:24:53 devstack cinder-volume[86324]: INFO cinder.rpc [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 05 09:24:53 devstack cinder-volume[86324]: INFO cinder.rpc [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 05 09:24:53 devstack cinder-volume[86324]: DEBUG oslo_db.sqlalchemy.engines [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86324) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 09:24:53 devstack cinder-volume[86324]: INFO cinder.volume.manager [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] Determined volume DB was empty at startup.
Nov 05 09:24:53 devstack cinder-volume[86324]: DEBUG cinder.volume.manager [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86324) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 05 09:24:53 devstack cinder-volume[86324]: WARNING stevedore.named [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 09:24:53 devstack cinder-volume[86324]: WARNING castellan.key_manager [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 09:24:53 devstack cinder-volume[86324]: WARNING cinder.keymgr.conf_key_mgr [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 09:24:53 devstack cinder-volume[86324]: INFO cinder.volume.manager [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 05 09:24:53 devstack cinder-volume[86324]: DEBUG oslo_db.sqlalchemy.engines [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86324) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 09:24:54 devstack cinder-volume[86324]: INFO oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] Starting 1 workers
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] Started child 86649 {{(pid=86324) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] Full set of CONF: {{(pid=86324) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] ******************************************************************************** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] Configuration options gathered from: {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 05 09:24:54 devstack cinder-volume[86649]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] ================================================================================ {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] allow_availability_zone_fallback = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] allow_compression_on_image_upload = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] allowed_direct_url_schemes     = [] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] api_rate_limit                 = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] auth_strategy                  = keystone {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_availability_zone      = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_host                   = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_name                   = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_stats_polling_interval = 60 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backup_api_class               = cinder.backup.api.API {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backup_name_template           = backup-%s {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backup_use_same_host           = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backup_use_temp_snapshot       = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] chap_password                  = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] chap_username                  =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cinder_internal_tenant_project_id = 3a3087dd1fca4b0f8ad751e6a8643056 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cinder_internal_tenant_user_id = 43fb5a6c7fa64c4fbd8151fc0bd16c76 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cluster                        = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] compression_format             = gzip {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] compute_api_class              = cinder.compute.nova.API {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] config_dir                     = [] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] config_source                  = [] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] control_exchange               = openstack {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] debug                          = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] default_availability_zone      = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] default_group_type             = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] default_volume_type            = QuobyteHD {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] disk_geometry                  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] driver_client_cert             = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] driver_client_cert_key         = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] driver_data_namespace          = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] driver_ssl_cert_path           = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] driver_ssl_cert_verify         = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] driver_use_ssl                 = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] enable_new_services            = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] enable_unsupported_driver      = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] enabled_backends               = ['QuobyteHD'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] enforce_multipath_for_image_xfer = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] filter_function                = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] glance_api_insecure            = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] glance_api_servers             = ['http://192.168.122.7/image'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] glance_api_ssl_compression     = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] glance_ca_certificates_file    = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] glance_catalog_info            = image:glance:publicURL {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] glance_certfile                = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86649) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] glance_keyfile                 = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] glance_num_retries             = 3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] glance_request_timeout         = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] goodness_function              = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] graceful_shutdown_timeout      = 5 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] group_api_class                = cinder.group.api.API {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] host                           = devstack {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] image_compress_on_upload       = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] image_conversion_address_space_limit = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] image_conversion_cpu_limit     = 60 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] image_conversion_disable       = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] image_introspection_address_space_limit = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] image_introspection_cpu_limit  = 60 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] image_upload_use_cinder_backend = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] image_upload_use_internal_tenant = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] image_volume_cache_enabled     = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] image_volume_cache_max_count   = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] image_volume_cache_max_size_gb = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] init_host_max_objects_retrieval = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] instance_format                = [instance: %(uuid)s]  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] iscsi_target_flags             =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] iscsi_write_cache              = on {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] iser_helper                    = tgtadm {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] iser_ip_address                = 192.168.122.7 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] iser_port                      = 3260 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] log_color                      = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] log_config_append              = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] log_dir                        = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] log_file                       = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] log_options                    = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] log_rotate_interval            = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] log_rotate_interval_type       = days {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] log_rotation_type              = none {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] max_age                        = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] max_logfile_count              = 30 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] max_logfile_size_mb            = 200 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] max_over_subscription_ratio    = 20.0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] message_reap_interval          = 86400 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] message_ttl                    = 2592000 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] migration_create_volume_timeout_secs = 300 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] monkey_patch                   = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] monkey_patch_modules           = [] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] my_ip                          = 192.168.122.7 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] no_snapshot_gb_quota           = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] num_iser_scan_tries            = 3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] num_shell_tries                = 3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] num_volume_device_scan_tries   = 3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] nvmeof_conn_info_version       = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] nvmet_ns_id                    = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] nvmet_port_id                  = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] osapi_max_limit                = 1000 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] osapi_volume_ext_list          = [] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack sudo[86655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] osapi_volume_listen_port       = 8776 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] osapi_volume_use_ssl           = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] osapi_volume_workers           = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] per_volume_size_limit          = -1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] periodic_fuzzy_delay           = 60 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] periodic_interval              = 60 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack sudo[86655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] public_endpoint                = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] publish_errors                 = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] quota_backup_gigabytes         = 1000 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] quota_backups                  = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] quota_gigabytes                = 1000 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] quota_groups                   = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] quota_snapshots                = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] quota_volumes                  = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] rate_limit_burst               = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] rate_limit_except_level        = CRITICAL {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] rate_limit_interval            = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] reinit_driver_count            = 3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] replication_device             = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] report_discard_supported       = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] report_interval                = 120 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] reservation_clean_interval     = 86400 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] reservation_expire             = 86400 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] reserved_image_namespaces      = [] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] reserved_percentage            = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] rpc_response_timeout           = 120 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] run_external_periodic_tasks    = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86649) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] scst_target_driver             = iscsi {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] scst_target_iqn_name           = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] service_down_time              = 720 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] shell_completion               = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] snapshot_name_template         = snapshot-%s {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] split_loggers                  = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] state_path                     = /opt/stack/data/cinder {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] storage_availability_zone      = nova {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] storage_protocol               = iSCSI {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.quobyte [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 05 09:24:54 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.quobyte [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] syslog_log_facility            = LOG_USER {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] target_helper                  = lioadm {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] target_ip_address              = 192.168.122.7 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] target_port                    = 3260 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] target_protocol                = iscsi {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] target_secondary_ip_addresses  = [] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] trace_flags                    = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] Running cmd (subprocess): mount.quobyte {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] transport_url                  = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] until_refresh                  = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] use_chap_auth                  = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] use_default_quota_class        = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] use_journal                    = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] use_json                       = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] use_multipath_for_image_xfer   = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] use_stderr                     = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] use_syslog                     = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] verify_glance_signatures       = enabled {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] volume_api_class               = cinder.volume.api.API {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] volume_backend_name            = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] volume_clear                   = zero {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] volume_clear_ionice            = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] volume_clear_size              = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] volume_copy_bps_limit          = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] volume_dd_blocksize            = 1M {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] volume_name_template           = volume-%s {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] volume_service_inithost_offload = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] volume_usage_audit_period      = month {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] zoning_mode                    = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_concurrency.disable_process_locking = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.auth_section = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.auth_type   = password {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.auth_version = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.cache       = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.certfile    = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.delay_auth_decision = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:54 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.http_connect_timeout = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:54 devstack sudo[86655]: pam_unix(sudo:session): session closed for user root
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.include_service_catalog = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.insecure    = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.interface   = public {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.keyfile     = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.memcache_password = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.memcache_username = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.region_name = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.service_token_roles_required = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.service_type = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.token_cache_time = 300 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.7/identity {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.backend                  = dogpile.cache.null {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.backend_argument         = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.backend_expiration_time  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.config_prefix            = cache.oslo {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.debug_cache_backend      = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.enable_retry_client      = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.enable_socket_keepalive  = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.enabled                  = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.expiration_time          = 600 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.hashclient_retry_attempts = 2 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.memcache_dead_retry      = 300 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.memcache_pool_maxsize    = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.memcache_sasl_enabled    = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.password                 = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.proxies                  = [] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.redis_db                 = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.redis_sentinel_service_name = mymaster {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.redis_server             = localhost:6379 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.retry_attempts           = 2 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.retry_delay              = 0.0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.socket_keepalive_count   = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.socket_keepalive_idle    = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.socket_keepalive_interval = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack sudo[86661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.socket_timeout           = 1.0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.tls_allowed_ciphers      = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.tls_cafile               = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.tls_certfile             = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.tls_enabled              = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.tls_keyfile              = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cache.username                 = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack sudo[86661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] coordination.backend_url       = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] database.asyncio_connection    = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] database.asyncio_slave_connection = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] database.backend               = sqlalchemy {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] database.connection            = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] database.connection_debug      = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] database.connection_parameters =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] database.connection_recycle_time = 3600 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] database.connection_trace      = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] database.db_inc_retry_interval = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] database.db_max_retries        = 20 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] database.db_max_retry_interval = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] database.db_retry_interval     = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] database.max_overflow          = 50 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] database.max_pool_size         = 5 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] database.max_retries           = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] database.mysql_wsrep_sync_wait = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] database.pool_timeout          = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] database.retry_interval        = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] CMD "mount.quobyte" returned: 1 in 0.112s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] database.slave_connection      = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] database.sqlite_synchronous    = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] database.synchronous_reader    = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] database.use_db_reconnect      = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:24:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_tracing.insecure = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] profiler.connection_string     = messaging:// {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] profiler.enabled               = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] profiler.es_doc_type           = notification {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] profiler.es_scroll_size        = 10000 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] profiler.es_scroll_time        = 2m {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] profiler.filter_error_trace    = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] profiler.hmac_keys             = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] profiler.sentinel_service_name = mymaster {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] profiler.socket_timeout        = 0.1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] profiler.trace_requests        = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] profiler.trace_sqlalchemy      = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] profiler_jaeger.process_tags   = {} {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] profiler_jaeger.service_name_prefix = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] profiler_otlp.service_name_prefix = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_policy.enforce_new_defaults = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_policy.policy_default_rule = default {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_policy.policy_file        = policy.yaml {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:24:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:24:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] privsep_osbrick.group          = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] privsep_osbrick.helper_command = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] privsep_osbrick.user           = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cinder_sys_admin.group         = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cinder_sys_admin.helper_command = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] cinder_sys_admin.user          = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] service_user.auth_section      = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] service_user.auth_type         = password {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] service_user.cafile            = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] service_user.certfile          = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] service_user.collect_timing    = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] service_user.insecure          = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] service_user.keyfile           = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] service_user.send_service_user_token = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] service_user.split_loggers     = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] service_user.timeout           = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] service_user.tls_ciphers       = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] service_user.tls_min_version   = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] glance.auth_section            = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack sudo[86661]: pam_unix(sudo:session): session closed for user root
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] glance.auth_type               = password {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] glance.certfile                = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] glance.collect_timing          = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] glance.insecure                = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] glance.keyfile                 = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] glance.region_name             = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] glance.split_loggers           = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] glance.timeout                 = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] glance.tls_ciphers             = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] glance.tls_min_version         = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.backend_availability_zone = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.chap_password = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.chap_username =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.disk_geometry = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.driver_client_cert = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.driver_client_cert_key = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.driver_data_namespace = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.driver_use_ssl = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.enable_unsupported_driver = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.extra_capabilities = {} {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.filter_function = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.goodness_function = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.iscsi_target_flags =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.iscsi_write_cache = on {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.iser_helper   = tgtadm {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.iser_ip_address = 192.168.122.7 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.iser_port     = 3260 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.nas_host      =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.nas_login     = admin {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.nas_mount_options = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.nas_password  = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.nas_private_key =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.nas_share_path =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.num_shell_tries = 3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.nvmet_port_id = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.quobyte_client_cfg = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.quobyte_volume_url = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.replication_device = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.report_discard_supported = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.reserved_percentage = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.scst_target_driver = iscsi {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.scst_target_iqn_name = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.storage_protocol = iSCSI {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.target_helper = tgtadm {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.target_ip_address = 192.168.122.7 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.target_port   = 3260 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.target_protocol = iscsi {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.trace_flags   = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.unique_fqdn_network = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.use_chap_auth = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.volume_backend_name = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.volume_clear  = zero {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.volume_clear_ionice = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.volume_clear_size = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_reports.file_event_handler = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_reports.log_dir           = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.backend_availability_zone = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.backend_host         = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.chap_password        = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.chap_username        = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.chiscsi_conf         = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.disk_geometry        = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.driver_client_cert   = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.driver_client_cert_key = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.driver_data_namespace = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.driver_use_ssl       = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.extra_capabilities   = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.filter_function      = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.goodness_function    = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.iser_helper          = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.iser_ip_address      = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.iser_port            = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.iser_target_prefix   = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.nas_host             = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.nas_login            = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.nas_mount_options    = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.nas_password         = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.nas_private_key      = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.nas_share_path       = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.nas_ssh_port         = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.num_shell_tries      = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.nvmet_port_id        = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.replication_device   = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.report_discard_supported = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.reserved_percentage  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.scst_target_driver   = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.storage_protocol     = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.target_helper        = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.target_ip_address    = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.target_port          = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.target_prefix        = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.target_protocol      = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.trace_flags          = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.use_chap_auth        = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.volume_clear         = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.volume_clear_size    = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] QuobyteHD.volumes_dir          = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.ssl      = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_notifications.driver = [] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_notifications.retry = -1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] oslo_messaging_notifications.transport_url = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] key_manager.fixed_key          = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] barbican.barbican_api_version  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] barbican.barbican_endpoint     = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] barbican.barbican_endpoint_type = public {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] barbican.barbican_region_name  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] barbican.cafile                = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] barbican.certfile              = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] barbican.collect_timing        = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] barbican.insecure              = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] barbican.keyfile               = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] barbican.number_of_retries     = 60 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] barbican.retry_delay           = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] barbican.send_service_user_token = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] barbican.split_loggers         = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] barbican.timeout               = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] barbican.tls_ciphers           = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] barbican.tls_min_version       = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] barbican.verify_ssl            = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] barbican.verify_ssl_path       = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] barbican_service_user.auth_section = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] barbican_service_user.auth_type = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] barbican_service_user.cafile   = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] barbican_service_user.certfile = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] barbican_service_user.collect_timing = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] barbican_service_user.insecure = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] barbican_service_user.keyfile  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] barbican_service_user.split_loggers = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] barbican_service_user.timeout  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] barbican_service_user.tls_ciphers = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] barbican_service_user.tls_min_version = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] vault.approle_role_id          = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] vault.approle_secret_id        = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] vault.auth_method              = approle {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] vault.auth_path                = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] vault.kv_mountpoint            = secret {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] vault.kv_path                  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] vault.kv_version               = 2 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] vault.namespace                = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] vault.root_token_id            = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] vault.ssl_ca_crt_file          = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] vault.timeout                  = 60.0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] vault.token_file               = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] vault.token_role               = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] vault.use_ssl                  = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 09:24:55 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-74c3a927-a30b-4d17-b571-f686e7af33ab None None] ******************************************************************************** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 05 09:24:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.620s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:24:55 devstack cinder-volume[86649]: INFO cinder.volume.driver [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] Driver hasn't implemented _init_vendor_properties()
Nov 05 09:24:55 devstack cinder-volume[86649]: DEBUG cinder.volume.driver [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.522720336914, 'free_capacity_gb': 1773.522720336914, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86649) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 05 09:24:55 devstack cinder-volume[86649]: DEBUG oslo_db.sqlalchemy.engines [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86649) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 09:24:55 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writer thread running {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 09:24:55 devstack cinder-volume[86649]: DEBUG cinder.db.api [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] Building query based on filter {{(pid=86649) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}}
Nov 05 09:24:55 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86649) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 05 09:24:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:24:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:24:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:24:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:24:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:24:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:24:55 devstack cinder-volume[86649]: INFO cinder.keymgr.migration [None req-aece813e-d6c1-4010-9dc8-78d82e88ae84 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 05 09:24:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.292s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:24:55 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:24:55 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] Driver initialization completed successfully.
Nov 05 09:24:55 devstack cinder-volume[86649]: INFO cinder.manager [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] Initiating service 3 cleanup
Nov 05 09:24:55 devstack cinder-volume[86649]: INFO cinder.manager [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] Service 3 cleanup completed.
Nov 05 09:24:55 devstack cinder-volume[86649]: DEBUG cinder.service [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] Creating RPC server for service cinder-volume {{(pid=86649) start /opt/stack/cinder/cinder/service.py:231}}
Nov 05 09:24:55 devstack cinder-volume[86649]: DEBUG cinder.service [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86649) start /opt/stack/cinder/cinder/service.py:237}}
Nov 05 09:24:55 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 05 09:24:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:24:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:24:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:24:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:24:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:24:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:24:55 devstack sudo[86673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:24:55 devstack sudo[86673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:24:56 devstack sudo[86673]: pam_unix(sudo:session): session closed for user root
Nov 05 09:24:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.375s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:24:56 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-1c506c0a-048e-4035-9adb-65d6c0925770 None None] Driver post RPC initialization completed successfully.
Nov 05 09:24:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cd240b40-d620-420b-a0e7-6071bb7f80c4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:24:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cd240b40-d620-420b-a0e7-6071bb7f80c4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:24:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-cd240b40-d620-420b-a0e7-6071bb7f80c4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:24:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-cd240b40-d620-420b-a0e7-6071bb7f80c4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:24:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cd240b40-d620-420b-a0e7-6071bb7f80c4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:24:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cd240b40-d620-420b-a0e7-6071bb7f80c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:24:56 devstack sudo[86682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:24:56 devstack sudo[86682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:24:56 devstack sudo[86682]: pam_unix(sudo:session): session closed for user root
Nov 05 09:24:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cd240b40-d620-420b-a0e7-6071bb7f80c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.263s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:24:56 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-cd240b40-d620-420b-a0e7-6071bb7f80c4 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:25:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:25:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 6 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:25:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:25:03 devstack cinder-volume[86324]: DEBUG dbcounter [-] [86324] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86324) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:25:05 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:25:06 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=3 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:25:57 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:25:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] Flow 'volume_create_manager' (fe342d1d-cc89-4587-a923-b81b00682919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:25:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4f4076e-862a-4cf1-8a17-a6f7af446d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:25:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4f4076e-862a-4cf1-8a17-a6f7af446d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1877954572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab519f3f-2ddb-4774-b83b-356895347bcc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bfb8d5a3643a4088af3e7ea8c3caa0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:25:58Z,use_quota=True,user_id='9a6767942c274e839289f5a0a4a925f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:25:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb0c27b5-676c-4d4a-82a1-04a2bb1f0158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:25:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb0c27b5-676c-4d4a-82a1-04a2bb1f0158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:25:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d186b62-576e-4b28-b0e8-415eeab22a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:25:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d186b62-576e-4b28-b0e8-415eeab22a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab519f3f-2ddb-4774-b83b-356895347bcc', 'volume_name': 'volume-ab519f3f-2ddb-4774-b83b-356895347bcc', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:25:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5a485be-6d58-4df1-8df6-bdee6c30a9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:25:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5a485be-6d58-4df1-8df6-bdee6c30a9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:25:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bba39d5-e29a-4d50-8010-0835a84efd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:25:57 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] Volume ab519f3f-2ddb-4774-b83b-356895347bcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab519f3f-2ddb-4774-b83b-356895347bcc', 'volume_size': 1}
Nov 05 09:25:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:25:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:25:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1877954572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab519f3f-2ddb-4774-b83b-356895347bcc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bfb8d5a3643a4088af3e7ea8c3caa0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:25:58Z,use_quota=True,user_id='9a6767942c274e839289f5a0a4a925f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:25:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] Creating volume ab519f3f-2ddb-4774-b83b-356895347bcc {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:25:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:25:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:25:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:25:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:25:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:25:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:25:57 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:25:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab519f3f-2ddb-4774-b83b-356895347bcc 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:25:57 devstack sudo[87573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab519f3f-2ddb-4774-b83b-356895347bcc 1073741824
Nov 05 09:25:57 devstack sudo[87573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:25:58 devstack sudo[87573]: pam_unix(sudo:session): session closed for user root
Nov 05 09:25:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab519f3f-2ddb-4774-b83b-356895347bcc 1073741824" returned: 0 in 0.587s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:25:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab519f3f-2ddb-4774-b83b-356895347bcc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:25:58 devstack sudo[87896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab519f3f-2ddb-4774-b83b-356895347bcc
Nov 05 09:25:58 devstack sudo[87896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:25:58 devstack sudo[87896]: pam_unix(sudo:session): session closed for user root
Nov 05 09:25:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab519f3f-2ddb-4774-b83b-356895347bcc" returned: 0 in 0.342s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:25:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:25:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:25:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bba39d5-e29a-4d50-8010-0835a84efd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab519f3f-2ddb-4774-b83b-356895347bcc', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:25:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d7f0394-b5bf-410d-96f5-d4f0d9cf4996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:25:58 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] Volume volume-ab519f3f-2ddb-4774-b83b-356895347bcc (ab519f3f-2ddb-4774-b83b-356895347bcc): created successfully
Nov 05 09:25:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d7f0394-b5bf-410d-96f5-d4f0d9cf4996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:25:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] Flow 'volume_create_manager' (fe342d1d-cc89-4587-a923-b81b00682919) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:25:58 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-03bf334f-1db2-480d-8228-ddfb8f429b8a tempest-VolumesTestJSON-1915733620 None] Created volume successfully.
Nov 05 09:26:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:26:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:26:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:26:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:26:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:26:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:26:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:00 devstack sudo[87900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:26:00 devstack sudo[87900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:00 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:26:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] Flow 'volume_create_manager' (e59f8ace-d9aa-4022-9cd2-7b0e1478e9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:26:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (569a4d30-adf2-4343-ac69-5ae111fa18a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (569a4d30-adf2-4343-ac69-5ae111fa18a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1851721129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770831b2-2840-4cb7-8adb-3378e4a61c0f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bfb8d5a3643a4088af3e7ea8c3caa0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:26:00Z,use_quota=True,user_id='9a6767942c274e839289f5a0a4a925f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86d3c5c1-851b-48ad-8427-1d7eedfbe2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86d3c5c1-851b-48ad-8427-1d7eedfbe2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cc2ebdf-a57e-44eb-af88-365130e075d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cc2ebdf-a57e-44eb-af88-365130e075d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '770831b2-2840-4cb7-8adb-3378e4a61c0f', 'volume_name': 'volume-770831b2-2840-4cb7-8adb-3378e4a61c0f', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58f6d28c-fb2d-4724-b746-f6a6593e7508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:00 devstack sudo[87900]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58f6d28c-fb2d-4724-b746-f6a6593e7508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07effabb-a69b-43aa-8e79-f12d37b829b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:00 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] Volume 770831b2-2840-4cb7-8adb-3378e4a61c0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-770831b2-2840-4cb7-8adb-3378e4a61c0f', 'volume_size': 1}
Nov 05 09:26:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:26:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:26:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1851721129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770831b2-2840-4cb7-8adb-3378e4a61c0f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bfb8d5a3643a4088af3e7ea8c3caa0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:26:00Z,use_quota=True,user_id='9a6767942c274e839289f5a0a4a925f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:26:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] Creating volume 770831b2-2840-4cb7-8adb-3378e4a61c0f {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:26:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:26:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:26:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:26:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:26:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:26:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:26:00 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:26:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-770831b2-2840-4cb7-8adb-3378e4a61c0f 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.449s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:26:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:26:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 6 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:26:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:26:00 devstack sudo[87904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-770831b2-2840-4cb7-8adb-3378e4a61c0f 1073741824
Nov 05 09:26:00 devstack sudo[87904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:01 devstack sudo[87904]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-770831b2-2840-4cb7-8adb-3378e4a61c0f 1073741824" returned: 0 in 0.551s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-770831b2-2840-4cb7-8adb-3378e4a61c0f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:01 devstack sudo[87911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-770831b2-2840-4cb7-8adb-3378e4a61c0f
Nov 05 09:26:01 devstack sudo[87911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:01 devstack sudo[87911]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-770831b2-2840-4cb7-8adb-3378e4a61c0f" returned: 0 in 0.284s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:26:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:26:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07effabb-a69b-43aa-8e79-f12d37b829b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-770831b2-2840-4cb7-8adb-3378e4a61c0f', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1668c52-08c0-4e0e-9261-461bc3eff800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:01 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] Volume volume-770831b2-2840-4cb7-8adb-3378e4a61c0f (770831b2-2840-4cb7-8adb-3378e4a61c0f): created successfully
Nov 05 09:26:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1668c52-08c0-4e0e-9261-461bc3eff800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] Flow 'volume_create_manager' (e59f8ace-d9aa-4022-9cd2-7b0e1478e9a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:26:01 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b1c06efe-fbee-4a64-8cf7-0236aaa59b2b tempest-VolumesTestJSON-1915733620 None] Created volume successfully.
Nov 05 09:26:03 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:26:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] Flow 'volume_create_manager' (59a2f5ef-c449-425f-9d5a-27fe18feb385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:26:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdbe2938-c65c-4738-8618-00cbffe01d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdbe2938-c65c-4738-8618-00cbffe01d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-945107074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf810055-1e42-49e1-a5e6-d86477f22189,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bfb8d5a3643a4088af3e7ea8c3caa0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:26:03Z,use_quota=True,user_id='9a6767942c274e839289f5a0a4a925f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (239e777c-f644-4ae8-ab6b-7b1027ba590f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (239e777c-f644-4ae8-ab6b-7b1027ba590f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de2fef76-f641-43d3-a02e-d638973e4bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de2fef76-f641-43d3-a02e-d638973e4bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf810055-1e42-49e1-a5e6-d86477f22189', 'volume_name': 'volume-bf810055-1e42-49e1-a5e6-d86477f22189', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61937389-ff4d-4cce-93c3-4997af64a121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61937389-ff4d-4cce-93c3-4997af64a121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3009a71-fe7d-4bb1-828e-923849b8721e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:03 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] Volume bf810055-1e42-49e1-a5e6-d86477f22189: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf810055-1e42-49e1-a5e6-d86477f22189', 'volume_size': 1}
Nov 05 09:26:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:26:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:26:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-945107074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf810055-1e42-49e1-a5e6-d86477f22189,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bfb8d5a3643a4088af3e7ea8c3caa0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:26:03Z,use_quota=True,user_id='9a6767942c274e839289f5a0a4a925f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:26:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] Creating volume bf810055-1e42-49e1-a5e6-d86477f22189 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:26:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:26:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:26:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:26:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:26:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:26:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:26:03 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:26:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bf810055-1e42-49e1-a5e6-d86477f22189 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:03 devstack sudo[87914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bf810055-1e42-49e1-a5e6-d86477f22189 1073741824
Nov 05 09:26:03 devstack sudo[87914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:03 devstack sudo[87914]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bf810055-1e42-49e1-a5e6-d86477f22189 1073741824" returned: 0 in 0.553s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bf810055-1e42-49e1-a5e6-d86477f22189 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:04 devstack sudo[87920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bf810055-1e42-49e1-a5e6-d86477f22189
Nov 05 09:26:04 devstack sudo[87920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:04 devstack sudo[87920]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bf810055-1e42-49e1-a5e6-d86477f22189" returned: 0 in 0.365s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:26:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:26:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3009a71-fe7d-4bb1-828e-923849b8721e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf810055-1e42-49e1-a5e6-d86477f22189', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a85c405f-c5ca-4ae1-965d-84d49563c4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:04 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] Volume volume-bf810055-1e42-49e1-a5e6-d86477f22189 (bf810055-1e42-49e1-a5e6-d86477f22189): created successfully
Nov 05 09:26:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a85c405f-c5ca-4ae1-965d-84d49563c4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] Flow 'volume_create_manager' (59a2f5ef-c449-425f-9d5a-27fe18feb385) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:26:04 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-5222f67f-c046-4193-ba10-766694b657aa tempest-VolumesTestJSON-1915733620 None] Created volume successfully.
Nov 05 09:26:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1b963340-c3da-4f98-a9bb-a3ba09c1759d tempest-VolumesTestJSON-1915733620 None] Acquiring lock "cinder-bf810055-1e42-49e1-a5e6-d86477f22189-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:26:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1b963340-c3da-4f98-a9bb-a3ba09c1759d tempest-VolumesTestJSON-1915733620 None] Lock "cinder-bf810055-1e42-49e1-a5e6-d86477f22189-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:26:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1b963340-c3da-4f98-a9bb-a3ba09c1759d tempest-VolumesTestJSON-1915733620 None] Acquiring lock "cinder-quobyte-bf810055-1e42-49e1-a5e6-d86477f22189" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:26:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1b963340-c3da-4f98-a9bb-a3ba09c1759d tempest-VolumesTestJSON-1915733620 None] Lock "cinder-quobyte-bf810055-1e42-49e1-a5e6-d86477f22189" acquired by "delete_volume" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:26:06 devstack cinder-volume[86649]: INFO oslo.privsep.daemon [None req-1b963340-c3da-4f98-a9bb-a3ba09c1759d tempest-VolumesTestJSON-1915733620 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpkpxucgm3/privsep.sock']
Nov 05 09:26:06 devstack sudo[87948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpkpxucgm3/privsep.sock
Nov 05 09:26:06 devstack sudo[87948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:07 devstack cinder-volume[86649]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Nov 05 09:26:07 devstack cinder-volume[86649]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 09:26:07 devstack cinder-volume[86649]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Nov 05 09:26:07 devstack cinder-volume[86649]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 05 09:26:07 devstack cinder-volume[86649]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Nov 05 09:26:07 devstack cinder-volume[86649]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Nov 05 09:26:07 devstack cinder-volume[86649]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 09:26:07 devstack cinder-volume[86649]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 05 09:26:07 devstack cinder-volume[86649]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Nov 05 09:26:08 devstack sudo[87948]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:08 devstack cinder-volume[86649]: INFO oslo.privsep.daemon [None req-1b963340-c3da-4f98-a9bb-a3ba09c1759d tempest-VolumesTestJSON-1915733620 None] Spawned new privsep daemon via rootwrap
Nov 05 09:26:08 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [None req-1b963340-c3da-4f98-a9bb-a3ba09c1759d tempest-VolumesTestJSON-1915733620 None] Accepted privsep connection to /tmp/tmpkpxucgm3/privsep.sock {{(pid=86649) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Nov 05 09:26:08 devstack cinder-volume[86649]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 05 09:26:08 devstack cinder-volume[86649]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 05 09:26:08 devstack cinder-volume[86649]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 05 09:26:08 devstack cinder-volume[86649]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87951
Nov 05 09:26:08 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a25d83-077b-4fc3-8af9-33bada1aaf74]: (2,) {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:26:08 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[074b2bdf-63c1-45b2-aac4-3ea4472d07dd]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:26:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1b963340-c3da-4f98-a9bb-a3ba09c1759d tempest-VolumesTestJSON-1915733620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bf810055-1e42-49e1-a5e6-d86477f22189 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:08 devstack sudo[87953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bf810055-1e42-49e1-a5e6-d86477f22189
Nov 05 09:26:08 devstack sudo[87953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:08 devstack sudo[87953]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1b963340-c3da-4f98-a9bb-a3ba09c1759d tempest-VolumesTestJSON-1915733620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bf810055-1e42-49e1-a5e6-d86477f22189" returned: 0 in 0.365s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1b963340-c3da-4f98-a9bb-a3ba09c1759d tempest-VolumesTestJSON-1915733620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bf810055-1e42-49e1-a5e6-d86477f22189 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:08 devstack sudo[87959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bf810055-1e42-49e1-a5e6-d86477f22189
Nov 05 09:26:08 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:08 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1b963340-c3da-4f98-a9bb-a3ba09c1759d tempest-VolumesTestJSON-1915733620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bf810055-1e42-49e1-a5e6-d86477f22189" returned: 0 in 0.266s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1b963340-c3da-4f98-a9bb-a3ba09c1759d tempest-VolumesTestJSON-1915733620 None] Lock "cinder-quobyte-bf810055-1e42-49e1-a5e6-d86477f22189" released by "delete_volume" :: held 1.895s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:26:08 devstack cinder-volume[86649]: WARNING cinder.quota [None req-1b963340-c3da-4f98-a9bb-a3ba09c1759d tempest-VolumesTestJSON-1915733620 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 05 09:26:08 devstack cinder-volume[86649]: WARNING cinder.quota [None req-1b963340-c3da-4f98-a9bb-a3ba09c1759d tempest-VolumesTestJSON-1915733620 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 05 09:26:08 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-1b963340-c3da-4f98-a9bb-a3ba09c1759d tempest-VolumesTestJSON-1915733620 None] Created reservations ['ff20449a-6d29-4f48-8a35-7331e25b3445', '85b1d4ae-27b2-4dd2-b490-67b972571dcb', '8b960fbf-376f-4458-9944-26da92bf8fe3', '7a7f4d50-48ec-4099-bd6c-919ec06259bd'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:26:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1b963340-c3da-4f98-a9bb-a3ba09c1759d tempest-VolumesTestJSON-1915733620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:26:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1b963340-c3da-4f98-a9bb-a3ba09c1759d tempest-VolumesTestJSON-1915733620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:26:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1b963340-c3da-4f98-a9bb-a3ba09c1759d tempest-VolumesTestJSON-1915733620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:26:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1b963340-c3da-4f98-a9bb-a3ba09c1759d tempest-VolumesTestJSON-1915733620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:26:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1b963340-c3da-4f98-a9bb-a3ba09c1759d tempest-VolumesTestJSON-1915733620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:26:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1b963340-c3da-4f98-a9bb-a3ba09c1759d tempest-VolumesTestJSON-1915733620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:09 devstack sudo[87962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:26:09 devstack sudo[87962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4b9aa9b1-c7a4-4d41-a4fe-874885e5b4f4 tempest-VolumesTestJSON-1915733620 None] Acquiring lock "cinder-770831b2-2840-4cb7-8adb-3378e4a61c0f-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:26:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4b9aa9b1-c7a4-4d41-a4fe-874885e5b4f4 tempest-VolumesTestJSON-1915733620 None] Lock "cinder-770831b2-2840-4cb7-8adb-3378e4a61c0f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:26:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4b9aa9b1-c7a4-4d41-a4fe-874885e5b4f4 tempest-VolumesTestJSON-1915733620 None] Acquiring lock "cinder-quobyte-770831b2-2840-4cb7-8adb-3378e4a61c0f" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:26:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4b9aa9b1-c7a4-4d41-a4fe-874885e5b4f4 tempest-VolumesTestJSON-1915733620 None] Lock "cinder-quobyte-770831b2-2840-4cb7-8adb-3378e4a61c0f" acquired by "delete_volume" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:26:09 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b70ac9-0334-4934-9641-c300d1d14846]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:26:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b9aa9b1-c7a4-4d41-a4fe-874885e5b4f4 tempest-VolumesTestJSON-1915733620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-770831b2-2840-4cb7-8adb-3378e4a61c0f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:09 devstack sudo[87962]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1b963340-c3da-4f98-a9bb-a3ba09c1759d tempest-VolumesTestJSON-1915733620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.301s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:09 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-1b963340-c3da-4f98-a9bb-a3ba09c1759d tempest-VolumesTestJSON-1915733620 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:26:09 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-1b963340-c3da-4f98-a9bb-a3ba09c1759d tempest-VolumesTestJSON-1915733620 None] Deleted volume successfully.
Nov 05 09:26:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1b963340-c3da-4f98-a9bb-a3ba09c1759d tempest-VolumesTestJSON-1915733620 None] Lock "cinder-bf810055-1e42-49e1-a5e6-d86477f22189-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:26:09 devstack sudo[87964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-770831b2-2840-4cb7-8adb-3378e4a61c0f
Nov 05 09:26:09 devstack sudo[87964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:09 devstack sudo[87964]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b9aa9b1-c7a4-4d41-a4fe-874885e5b4f4 tempest-VolumesTestJSON-1915733620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-770831b2-2840-4cb7-8adb-3378e4a61c0f" returned: 0 in 0.432s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b9aa9b1-c7a4-4d41-a4fe-874885e5b4f4 tempest-VolumesTestJSON-1915733620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-770831b2-2840-4cb7-8adb-3378e4a61c0f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:09 devstack sudo[87970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-770831b2-2840-4cb7-8adb-3378e4a61c0f
Nov 05 09:26:09 devstack sudo[87970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:09 devstack sudo[87970]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b9aa9b1-c7a4-4d41-a4fe-874885e5b4f4 tempest-VolumesTestJSON-1915733620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-770831b2-2840-4cb7-8adb-3378e4a61c0f" returned: 0 in 0.267s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4b9aa9b1-c7a4-4d41-a4fe-874885e5b4f4 tempest-VolumesTestJSON-1915733620 None] Lock "cinder-quobyte-770831b2-2840-4cb7-8adb-3378e4a61c0f" released by "delete_volume" :: held 0.750s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:26:10 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-4b9aa9b1-c7a4-4d41-a4fe-874885e5b4f4 tempest-VolumesTestJSON-1915733620 None] Created reservations ['c9cd353a-3526-420d-bfb6-ee3e23dd1809', '4054d839-193d-47f9-9ea6-22bae20b887d', 'd2e286ca-7779-40e4-8ca5-06cd7ed2e94a', '536d9b25-3d70-4c49-92cf-27db7d2f2f34'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:26:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4b9aa9b1-c7a4-4d41-a4fe-874885e5b4f4 tempest-VolumesTestJSON-1915733620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:26:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4b9aa9b1-c7a4-4d41-a4fe-874885e5b4f4 tempest-VolumesTestJSON-1915733620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:26:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4b9aa9b1-c7a4-4d41-a4fe-874885e5b4f4 tempest-VolumesTestJSON-1915733620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:26:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4b9aa9b1-c7a4-4d41-a4fe-874885e5b4f4 tempest-VolumesTestJSON-1915733620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:26:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4b9aa9b1-c7a4-4d41-a4fe-874885e5b4f4 tempest-VolumesTestJSON-1915733620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:26:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b9aa9b1-c7a4-4d41-a4fe-874885e5b4f4 tempest-VolumesTestJSON-1915733620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:10 devstack sudo[87973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:26:10 devstack sudo[87973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-306c6e0f-23d8-45e8-b979-b0bb4a053d1e tempest-VolumesTestJSON-1915733620 None] Acquiring lock "cinder-ab519f3f-2ddb-4774-b83b-356895347bcc-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:26:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-306c6e0f-23d8-45e8-b979-b0bb4a053d1e tempest-VolumesTestJSON-1915733620 None] Lock "cinder-ab519f3f-2ddb-4774-b83b-356895347bcc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:26:10 devstack sudo[87973]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b9aa9b1-c7a4-4d41-a4fe-874885e5b4f4 tempest-VolumesTestJSON-1915733620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.266s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:10 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-4b9aa9b1-c7a4-4d41-a4fe-874885e5b4f4 tempest-VolumesTestJSON-1915733620 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:26:10 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-4b9aa9b1-c7a4-4d41-a4fe-874885e5b4f4 tempest-VolumesTestJSON-1915733620 None] Deleted volume successfully.
Nov 05 09:26:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-306c6e0f-23d8-45e8-b979-b0bb4a053d1e tempest-VolumesTestJSON-1915733620 None] Acquiring lock "cinder-quobyte-ab519f3f-2ddb-4774-b83b-356895347bcc" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:26:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-306c6e0f-23d8-45e8-b979-b0bb4a053d1e tempest-VolumesTestJSON-1915733620 None] Lock "cinder-quobyte-ab519f3f-2ddb-4774-b83b-356895347bcc" acquired by "delete_volume" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:26:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4b9aa9b1-c7a4-4d41-a4fe-874885e5b4f4 tempest-VolumesTestJSON-1915733620 None] Lock "cinder-770831b2-2840-4cb7-8adb-3378e4a61c0f-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:26:10 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e5870e-5fc1-4a6c-b4fb-4bb81a24339f]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:26:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-306c6e0f-23d8-45e8-b979-b0bb4a053d1e tempest-VolumesTestJSON-1915733620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab519f3f-2ddb-4774-b83b-356895347bcc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:10 devstack sudo[87977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab519f3f-2ddb-4774-b83b-356895347bcc
Nov 05 09:26:10 devstack sudo[87977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:10 devstack sudo[87977]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-306c6e0f-23d8-45e8-b979-b0bb4a053d1e tempest-VolumesTestJSON-1915733620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab519f3f-2ddb-4774-b83b-356895347bcc" returned: 0 in 0.401s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-306c6e0f-23d8-45e8-b979-b0bb4a053d1e tempest-VolumesTestJSON-1915733620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab519f3f-2ddb-4774-b83b-356895347bcc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:10 devstack sudo[87982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab519f3f-2ddb-4774-b83b-356895347bcc
Nov 05 09:26:10 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:11 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-306c6e0f-23d8-45e8-b979-b0bb4a053d1e tempest-VolumesTestJSON-1915733620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab519f3f-2ddb-4774-b83b-356895347bcc" returned: 0 in 0.274s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-306c6e0f-23d8-45e8-b979-b0bb4a053d1e tempest-VolumesTestJSON-1915733620 None] Lock "cinder-quobyte-ab519f3f-2ddb-4774-b83b-356895347bcc" released by "delete_volume" :: held 0.731s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:26:11 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-306c6e0f-23d8-45e8-b979-b0bb4a053d1e tempest-VolumesTestJSON-1915733620 None] Created reservations ['ad863830-3a9e-4deb-8a1c-177b302b0dd6', 'e2d910e5-5a22-4dea-9ab9-e8c799a8554e', '04d59aa8-cd57-4cab-8c84-16a19433a669', '35fef2d5-0902-4f14-8c5c-5339d72329e0'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:26:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-306c6e0f-23d8-45e8-b979-b0bb4a053d1e tempest-VolumesTestJSON-1915733620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:26:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-306c6e0f-23d8-45e8-b979-b0bb4a053d1e tempest-VolumesTestJSON-1915733620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:26:11 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-306c6e0f-23d8-45e8-b979-b0bb4a053d1e tempest-VolumesTestJSON-1915733620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:26:11 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-306c6e0f-23d8-45e8-b979-b0bb4a053d1e tempest-VolumesTestJSON-1915733620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:26:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-306c6e0f-23d8-45e8-b979-b0bb4a053d1e tempest-VolumesTestJSON-1915733620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:26:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-306c6e0f-23d8-45e8-b979-b0bb4a053d1e tempest-VolumesTestJSON-1915733620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:11 devstack sudo[87985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:26:11 devstack sudo[87985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:11 devstack sudo[87985]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-306c6e0f-23d8-45e8-b979-b0bb4a053d1e tempest-VolumesTestJSON-1915733620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.295s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:11 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-306c6e0f-23d8-45e8-b979-b0bb4a053d1e tempest-VolumesTestJSON-1915733620 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:26:11 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-306c6e0f-23d8-45e8-b979-b0bb4a053d1e tempest-VolumesTestJSON-1915733620 None] Deleted volume successfully.
Nov 05 09:26:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-306c6e0f-23d8-45e8-b979-b0bb4a053d1e tempest-VolumesTestJSON-1915733620 None] Lock "cinder-ab519f3f-2ddb-4774-b83b-356895347bcc-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:26:21 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=21,cinder:INSERT=8,cinder:UPDATE=34,cinder:DELETE=3 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:26:21 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=32,cinder:SELECT=21,cinder:DELETE=3,cinder:INSERT=7 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:26:25 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-cda18402-6330-42a4-ab86-7570f39007ff tempest-GroupSnapshotsTest-1107232334 None] Group tempest-GroupSnapshotsTest-Group-1564523105: creating
Nov 05 09:26:25 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-cda18402-6330-42a4-ab86-7570f39007ff tempest-GroupSnapshotsTest-1107232334 None] Group tempest-GroupSnapshotsTest-Group-1564523105: created successfully
Nov 05 09:26:25 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-cda18402-6330-42a4-ab86-7570f39007ff tempest-GroupSnapshotsTest-1107232334 None] Create group completed successfully.
Nov 05 09:26:27 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:26:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] Flow 'volume_create_manager' (cadcce80-36ce-4731-aaf8-29fdd78c32f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:26:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54ad4f36-4b3b-4679-a896-a99b75ae8e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54ad4f36-4b3b-4679-a896-a99b75ae8e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-5551487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=73af7f00-3516-439e-b247-2fa364c5c5ca,host='devstack@QuobyteHD#QuobyteHD',id=927399fc-1462-4e8c-970f-5bf9370c449a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f67818608c8a473782469282b0687832',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:26:27Z,use_quota=True,user_id='1f634e8c23a94774b7be18328e509609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1be56aef-d925-425d-9aee-e3140a9549a6),volume_type_id=1be56aef-d925-425d-9aee-e3140a9549a6)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d96e9d-6408-4f3b-911f-975b87d70753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d96e9d-6408-4f3b-911f-975b87d70753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b6cc74-a7aa-4235-80e0-f78796c6da61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b6cc74-a7aa-4235-80e0-f78796c6da61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '927399fc-1462-4e8c-970f-5bf9370c449a', 'volume_name': 'volume-927399fc-1462-4e8c-970f-5bf9370c449a', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cbaea6f-efaa-46c6-9671-ca875aa48ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cbaea6f-efaa-46c6-9671-ca875aa48ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdb827b0-a208-4eca-acb0-54080019a2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:27 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] Volume 927399fc-1462-4e8c-970f-5bf9370c449a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-927399fc-1462-4e8c-970f-5bf9370c449a', 'volume_size': 1}
Nov 05 09:26:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:26:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:26:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=73af7f00-3516-439e-b247-2fa364c5c5ca,created_at=2026-11-05T08:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-5551487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=73af7f00-3516-439e-b247-2fa364c5c5ca,host='devstack@QuobyteHD#QuobyteHD',id=927399fc-1462-4e8c-970f-5bf9370c449a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f67818608c8a473782469282b0687832',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:26:27Z,use_quota=True,user_id='1f634e8c23a94774b7be18328e509609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1be56aef-d925-425d-9aee-e3140a9549a6),volume_type_id=1be56aef-d925-425d-9aee-e3140a9549a6)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:26:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] Creating volume 927399fc-1462-4e8c-970f-5bf9370c449a {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:26:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:26:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:26:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:26:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:26:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:26:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:26:27 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:26:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:27 devstack sudo[88094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a 1073741824
Nov 05 09:26:27 devstack sudo[88094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:28 devstack sudo[88094]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:28 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:26:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] Flow 'volume_create_manager' (e51f7fc0-0f8f-4278-8c92-195974b6fac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:26:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4fe10c7-936b-4ecd-a8c8-6a19daaa6714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a 1073741824" returned: 0 in 0.602s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4fe10c7-936b-4ecd-a8c8-6a19daaa6714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1708226211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf451386-0715-46b1-9a1b-3daba6f5e8ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a92862d182b4f649d59c4742f83e5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:26:28Z,use_quota=True,user_id='f9aa60f647dc4c3b9efe7589dd716cb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de4ec3d1-60fe-4237-9b18-df1937167f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de4ec3d1-60fe-4237-9b18-df1937167f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59fe916c-548b-4fa8-959d-6cc3130ddd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59fe916c-548b-4fa8-959d-6cc3130ddd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf451386-0715-46b1-9a1b-3daba6f5e8ee', 'volume_name': 'volume-cf451386-0715-46b1-9a1b-3daba6f5e8ee', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ab83dc-2b84-4332-97df-f7dea0f0d0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ab83dc-2b84-4332-97df-f7dea0f0d0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d6bf03-0d6c-4abb-828c-175b1b65725d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:28 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] Volume cf451386-0715-46b1-9a1b-3daba6f5e8ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf451386-0715-46b1-9a1b-3daba6f5e8ee', 'volume_size': 1}
Nov 05 09:26:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:26:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:28 devstack sudo[88102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a
Nov 05 09:26:28 devstack sudo[88102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:28 devstack sudo[88102]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a" returned: 0 in 0.261s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:26:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:26:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.307s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:26:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1708226211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf451386-0715-46b1-9a1b-3daba6f5e8ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a92862d182b4f649d59c4742f83e5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:26:28Z,use_quota=True,user_id='f9aa60f647dc4c3b9efe7589dd716cb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:26:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] Creating volume cf451386-0715-46b1-9a1b-3daba6f5e8ee {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:26:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:26:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:26:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:26:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:26:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:26:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:26:28 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:26:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cf451386-0715-46b1-9a1b-3daba6f5e8ee 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdb827b0-a208-4eca-acb0-54080019a2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-927399fc-1462-4e8c-970f-5bf9370c449a', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c68df58f-4667-4b00-bf91-eff8ebe610d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:28 devstack sudo[88106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cf451386-0715-46b1-9a1b-3daba6f5e8ee 1073741824
Nov 05 09:26:28 devstack sudo[88106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:28 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] Volume volume-927399fc-1462-4e8c-970f-5bf9370c449a (927399fc-1462-4e8c-970f-5bf9370c449a): created successfully
Nov 05 09:26:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c68df58f-4667-4b00-bf91-eff8ebe610d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] Flow 'volume_create_manager' (cadcce80-36ce-4731-aaf8-29fdd78c32f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:26:28 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-a33aa289-a03b-400e-9909-f507aea2dadb tempest-GroupSnapshotsTest-1107232334 None] Created volume successfully.
Nov 05 09:26:29 devstack sudo[88106]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cf451386-0715-46b1-9a1b-3daba6f5e8ee 1073741824" returned: 0 in 0.535s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cf451386-0715-46b1-9a1b-3daba6f5e8ee {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:29 devstack sudo[88145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cf451386-0715-46b1-9a1b-3daba6f5e8ee
Nov 05 09:26:29 devstack sudo[88145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:29 devstack sudo[88145]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cf451386-0715-46b1-9a1b-3daba6f5e8ee" returned: 0 in 0.269s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:26:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:26:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d6bf03-0d6c-4abb-828c-175b1b65725d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf451386-0715-46b1-9a1b-3daba6f5e8ee', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b848f35b-06f8-4da7-a43d-d19581f9d6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:29 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] Volume volume-cf451386-0715-46b1-9a1b-3daba6f5e8ee (cf451386-0715-46b1-9a1b-3daba6f5e8ee): created successfully
Nov 05 09:26:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b848f35b-06f8-4da7-a43d-d19581f9d6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] Flow 'volume_create_manager' (e51f7fc0-0f8f-4278-8c92-195974b6fac0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:26:29 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-446319f7-6ed7-4463-87fa-ff69caf84b0d tempest-DeleteServersTestJSON-1377846981 None] Created volume successfully.
Nov 05 09:26:30 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-44b30471-65e1-434e-b8e7-e7b385712d3c tempest-GroupSnapshotsTest-1107232334 None] GroupSnapshot d510fbff-c1b3-4ce0-baa6-49a62f7395fb: creating.
Nov 05 09:26:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-44b30471-65e1-434e-b8e7-e7b385712d3c tempest-GroupSnapshotsTest-1107232334 None] Group snapshot d510fbff-c1b3-4ce0-baa6-49a62f7395fb: creating. {{(pid=86649) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 05 09:26:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-44b30471-65e1-434e-b8e7-e7b385712d3c tempest-GroupSnapshotsTest-1107232334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:26:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-44b30471-65e1-434e-b8e7-e7b385712d3c tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:26:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-44b30471-65e1-434e-b8e7-e7b385712d3c tempest-GroupSnapshotsTest-1107232334 None] Creating offline snapshot 25802fe6-03a7-4207-a015-bbfb43e06486 of volume 927399fc-1462-4e8c-970f-5bf9370c449a {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 09:26:30 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e19f519-9754-4341-b43a-3ebdd23e7ebf]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:26:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-44b30471-65e1-434e-b8e7-e7b385712d3c tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:30 devstack sudo[88150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a
Nov 05 09:26:30 devstack sudo[88150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:30 devstack sudo[88150]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-44b30471-65e1-434e-b8e7-e7b385712d3c tempest-GroupSnapshotsTest-1107232334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a" returned: 0 in 0.452s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-44b30471-65e1-434e-b8e7-e7b385712d3c tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a.25802fe6-03a7-4207-a015-bbfb43e06486 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:30 devstack sudo[88161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a.25802fe6-03a7-4207-a015-bbfb43e06486 1G
Nov 05 09:26:30 devstack sudo[88161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:31 devstack sudo[88161]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-44b30471-65e1-434e-b8e7-e7b385712d3c tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a.25802fe6-03a7-4207-a015-bbfb43e06486 1G" returned: 0 in 0.540s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-44b30471-65e1-434e-b8e7-e7b385712d3c tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-927399fc-1462-4e8c-970f-5bf9370c449a -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a.25802fe6-03a7-4207-a015-bbfb43e06486 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:31 devstack sudo[88167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-927399fc-1462-4e8c-970f-5bf9370c449a -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a.25802fe6-03a7-4207-a015-bbfb43e06486
Nov 05 09:26:31 devstack sudo[88167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:31 devstack sudo[88167]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-44b30471-65e1-434e-b8e7-e7b385712d3c tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-927399fc-1462-4e8c-970f-5bf9370c449a -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a.25802fe6-03a7-4207-a015-bbfb43e06486" returned: 0 in 0.337s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:31 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-44b30471-65e1-434e-b8e7-e7b385712d3c tempest-GroupSnapshotsTest-1107232334 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a.25802fe6-03a7-4207-a015-bbfb43e06486 is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 09:26:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-44b30471-65e1-434e-b8e7-e7b385712d3c tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a.25802fe6-03a7-4207-a015-bbfb43e06486 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:31 devstack sudo[88176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a.25802fe6-03a7-4207-a015-bbfb43e06486
Nov 05 09:26:31 devstack sudo[88176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:31 devstack sudo[88176]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-44b30471-65e1-434e-b8e7-e7b385712d3c tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a.25802fe6-03a7-4207-a015-bbfb43e06486" returned: 0 in 0.264s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-44b30471-65e1-434e-b8e7-e7b385712d3c tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:31 devstack sudo[88179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a.info
Nov 05 09:26:31 devstack sudo[88179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:32 devstack sudo[88179]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-44b30471-65e1-434e-b8e7-e7b385712d3c tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a.info" returned: 0 in 0.312s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:32 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-44b30471-65e1-434e-b8e7-e7b385712d3c tempest-GroupSnapshotsTest-1107232334 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 09:26:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-44b30471-65e1-434e-b8e7-e7b385712d3c tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:32 devstack sudo[88182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a.info
Nov 05 09:26:32 devstack sudo[88182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:32 devstack sudo[88182]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-44b30471-65e1-434e-b8e7-e7b385712d3c tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a.info" returned: 0 in 0.321s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-44b30471-65e1-434e-b8e7-e7b385712d3c tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.388s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:26:32 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-44b30471-65e1-434e-b8e7-e7b385712d3c tempest-GroupSnapshotsTest-1107232334 None] group_snapshot d510fbff-c1b3-4ce0-baa6-49a62f7395fb: created successfully
Nov 05 09:26:32 devstack cinder-volume[86649]: WARNING py.warnings [req-ee264ad7-6653-4275-b8d6-2cc19b4c4e42 req-8a25863b-48f4-44a2-8ce3-97f77103030d tempest-DeleteServersTestJSON-1377846981 None] /opt/stack/cinder/cinder/db/api.py:2442: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Nov 05 09:26:32 devstack cinder-volume[86649]:   .first()
Nov 05 09:26:32 devstack cinder-volume[86649]: 
Nov 05 09:26:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-ee264ad7-6653-4275-b8d6-2cc19b4c4e42 req-8a25863b-48f4-44a2-8ce3-97f77103030d tempest-DeleteServersTestJSON-1377846981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:26:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-ee264ad7-6653-4275-b8d6-2cc19b4c4e42 req-8a25863b-48f4-44a2-8ce3-97f77103030d tempest-DeleteServersTestJSON-1377846981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:26:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-ee264ad7-6653-4275-b8d6-2cc19b4c4e42 req-8a25863b-48f4-44a2-8ce3-97f77103030d tempest-DeleteServersTestJSON-1377846981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:26:33 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-ee264ad7-6653-4275-b8d6-2cc19b4c4e42 req-8a25863b-48f4-44a2-8ce3-97f77103030d tempest-DeleteServersTestJSON-1377846981 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1', 'name': 'volume-cf451386-0715-46b1-9a1b-3daba6f5e8ee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32fb9166-5a78-4c98-8574-bd62a7dace92', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 09:26:33 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-ee264ad7-6653-4275-b8d6-2cc19b4c4e42 req-8a25863b-48f4-44a2-8ce3-97f77103030d tempest-DeleteServersTestJSON-1377846981 None] attachment_update completed successfully.
Nov 05 09:26:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:26:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:26:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] Acquiring lock "cinder-quobyte-25802fe6-03a7-4207-a015-bbfb43e06486-bc53399b-52b0-4055-81e2-a1f937af00b5" by "_create_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:26:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] Lock "cinder-quobyte-25802fe6-03a7-4207-a015-bbfb43e06486-bc53399b-52b0-4055-81e2-a1f937af00b5" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:26:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] Creating volume bc53399b-52b0-4055-81e2-a1f937af00b5 from snapshot 25802fe6-03a7-4207-a015-bbfb43e06486 {{(pid=86649) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 09:26:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:26:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:26:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:26:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:26:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:26:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:26:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] Acquiring lock "cinder-quobyte-bc53399b-52b0-4055-81e2-a1f937af00b5" by "_copy_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:26:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] Lock "cinder-quobyte-bc53399b-52b0-4055-81e2-a1f937af00b5" acquired by "_copy_volume_from_snapshot" :: waited 0.047s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:26:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] snapshot: 25802fe6-03a7-4207-a015-bbfb43e06486, volume: bc53399b-52b0-4055-81e2-a1f937af00b5,  {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 09:26:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:26:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:26:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:26:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:26:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:26:34 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fc815f-837b-42e5-93d6-259f4024a7c7]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:26:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a.25802fe6-03a7-4207-a015-bbfb43e06486 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:34 devstack sudo[88614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a.25802fe6-03a7-4207-a015-bbfb43e06486
Nov 05 09:26:34 devstack sudo[88614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:35 devstack sudo[88614]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a.25802fe6-03a7-4207-a015-bbfb43e06486" returned: 0 in 0.535s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-927399fc-1462-4e8c-970f-5bf9370c449a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:26:35 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aec014e-c470-417e-a50d-cb764b033acb]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:26:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:35 devstack sudo[88622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a
Nov 05 09:26:35 devstack sudo[88622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:35 devstack sudo[88622]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a" returned: 0 in 0.556s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 09:26:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] Creating direct copy from snapshot {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 09:26:35 devstack cinder-volume[86649]: DEBUG cinder.utils [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] Path /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bc53399b-52b0-4055-81e2-a1f937af00b5 not found in is_blk_device check {{(pid=86649) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 09:26:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bc53399b-52b0-4055-81e2-a1f937af00b5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:35 devstack sudo[88677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bc53399b-52b0-4055-81e2-a1f937af00b5
Nov 05 09:26:35 devstack sudo[88677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:37 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-e58e3f3e-8615-4559-b205-0e86b6e05801 req-e2c309ff-c229-469d-99b5-b5fa4f62d4b1 tempest-DeleteServersTestJSON-1377846981 None] Terminate volume connection completed successfully.
Nov 05 09:26:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-e58e3f3e-8615-4559-b205-0e86b6e05801 req-e2c309ff-c229-469d-99b5-b5fa4f62d4b1 tempest-DeleteServersTestJSON-1377846981 None] Deleting attachment 32fb9166-5a78-4c98-8574-bd62a7dace92. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 09:26:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2e1adb5c-7986-479f-a47e-8a485a7b3c13 tempest-DeleteServersTestJSON-1377846981 None] Acquiring lock "cinder-cf451386-0715-46b1-9a1b-3daba6f5e8ee-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:26:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2e1adb5c-7986-479f-a47e-8a485a7b3c13 tempest-DeleteServersTestJSON-1377846981 None] Lock "cinder-cf451386-0715-46b1-9a1b-3daba6f5e8ee-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:26:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2e1adb5c-7986-479f-a47e-8a485a7b3c13 tempest-DeleteServersTestJSON-1377846981 None] Acquiring lock "cinder-quobyte-cf451386-0715-46b1-9a1b-3daba6f5e8ee" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:26:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2e1adb5c-7986-479f-a47e-8a485a7b3c13 tempest-DeleteServersTestJSON-1377846981 None] Lock "cinder-quobyte-cf451386-0715-46b1-9a1b-3daba6f5e8ee" acquired by "delete_volume" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:26:39 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8b46e1-5d3b-429a-b369-2f8597d4934b]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:26:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e1adb5c-7986-479f-a47e-8a485a7b3c13 tempest-DeleteServersTestJSON-1377846981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cf451386-0715-46b1-9a1b-3daba6f5e8ee {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:39 devstack sudo[88708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cf451386-0715-46b1-9a1b-3daba6f5e8ee
Nov 05 09:26:39 devstack sudo[88708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:40 devstack sudo[88708]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e1adb5c-7986-479f-a47e-8a485a7b3c13 tempest-DeleteServersTestJSON-1377846981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cf451386-0715-46b1-9a1b-3daba6f5e8ee" returned: 0 in 0.703s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e1adb5c-7986-479f-a47e-8a485a7b3c13 tempest-DeleteServersTestJSON-1377846981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cf451386-0715-46b1-9a1b-3daba6f5e8ee {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:40 devstack sudo[88719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cf451386-0715-46b1-9a1b-3daba6f5e8ee
Nov 05 09:26:40 devstack sudo[88719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:40 devstack sudo[88719]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e1adb5c-7986-479f-a47e-8a485a7b3c13 tempest-DeleteServersTestJSON-1377846981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cf451386-0715-46b1-9a1b-3daba6f5e8ee" returned: 0 in 0.476s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2e1adb5c-7986-479f-a47e-8a485a7b3c13 tempest-DeleteServersTestJSON-1377846981 None] Lock "cinder-quobyte-cf451386-0715-46b1-9a1b-3daba6f5e8ee" released by "delete_volume" :: held 1.269s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:26:40 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-2e1adb5c-7986-479f-a47e-8a485a7b3c13 tempest-DeleteServersTestJSON-1377846981 None] Created reservations ['715727b6-1f33-4484-92ff-1e4fe07bed21', '45541a8f-5cbf-4272-acea-9ecd2855e538', '3ce86a70-8f70-4595-a9e3-b0fe07bf927e', '125ba393-7192-4d1f-aaeb-a2f43e90b00e'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:26:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2e1adb5c-7986-479f-a47e-8a485a7b3c13 tempest-DeleteServersTestJSON-1377846981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:26:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2e1adb5c-7986-479f-a47e-8a485a7b3c13 tempest-DeleteServersTestJSON-1377846981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:26:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2e1adb5c-7986-479f-a47e-8a485a7b3c13 tempest-DeleteServersTestJSON-1377846981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:26:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2e1adb5c-7986-479f-a47e-8a485a7b3c13 tempest-DeleteServersTestJSON-1377846981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:26:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2e1adb5c-7986-479f-a47e-8a485a7b3c13 tempest-DeleteServersTestJSON-1377846981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:26:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e1adb5c-7986-479f-a47e-8a485a7b3c13 tempest-DeleteServersTestJSON-1377846981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:40 devstack sudo[88722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:26:40 devstack sudo[88722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:41 devstack sudo[88722]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e1adb5c-7986-479f-a47e-8a485a7b3c13 tempest-DeleteServersTestJSON-1377846981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.386s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:41 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-2e1adb5c-7986-479f-a47e-8a485a7b3c13 tempest-DeleteServersTestJSON-1377846981 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:26:41 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-2e1adb5c-7986-479f-a47e-8a485a7b3c13 tempest-DeleteServersTestJSON-1377846981 None] Deleted volume successfully.
Nov 05 09:26:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2e1adb5c-7986-479f-a47e-8a485a7b3c13 tempest-DeleteServersTestJSON-1377846981 None] Lock "cinder-cf451386-0715-46b1-9a1b-3daba6f5e8ee-delete_volume" released by "delete_volume" :: held 2.124s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:26:43 devstack sudo[88677]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bc53399b-52b0-4055-81e2-a1f937af00b5" returned: 0 in 7.954s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:43 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] Image conversion details: src /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a, size 1024.00 MB, duration 7.96 sec, destination /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bc53399b-52b0-4055-81e2-a1f937af00b5 {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 09:26:43 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] Converted 1024.00 MB image at 128.72 MB/s
Nov 05 09:26:43 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bc53399b-52b0-4055-81e2-a1f937af00b5 is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 09:26:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bc53399b-52b0-4055-81e2-a1f937af00b5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:43 devstack sudo[88725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bc53399b-52b0-4055-81e2-a1f937af00b5
Nov 05 09:26:43 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:44 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bc53399b-52b0-4055-81e2-a1f937af00b5" returned: 0 in 0.241s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] Lock "cinder-quobyte-bc53399b-52b0-4055-81e2-a1f937af00b5" released by "_copy_volume_from_snapshot" :: held 9.450s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:26:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] Lock "cinder-quobyte-25802fe6-03a7-4207-a015-bbfb43e06486-bc53399b-52b0-4055-81e2-a1f937af00b5" released by "_create_volume_from_snapshot" :: held 9.552s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:26:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.584s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:26:44 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-8f823cbf-2dc5-40ae-8a7c-37481ddf04f7 tempest-GroupSnapshotsTest-1107232334 None] Create group from source-snapshot-d510fbff-c1b3-4ce0-baa6-49a62f7395fb completed successfully.
Nov 05 09:26:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2e384bdf-5c7f-4c3e-b31e-47209ee05256 tempest-GroupSnapshotsTest-1107232334 None] Acquiring lock "cinder-quobyte-bc53399b-52b0-4055-81e2-a1f937af00b5" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:26:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2e384bdf-5c7f-4c3e-b31e-47209ee05256 tempest-GroupSnapshotsTest-1107232334 None] Lock "cinder-quobyte-bc53399b-52b0-4055-81e2-a1f937af00b5" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:26:44 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d9ff15-4704-4db7-ae27-514cae32e364]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:26:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e384bdf-5c7f-4c3e-b31e-47209ee05256 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bc53399b-52b0-4055-81e2-a1f937af00b5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:44 devstack sudo[88729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bc53399b-52b0-4055-81e2-a1f937af00b5
Nov 05 09:26:44 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:45 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e384bdf-5c7f-4c3e-b31e-47209ee05256 tempest-GroupSnapshotsTest-1107232334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bc53399b-52b0-4055-81e2-a1f937af00b5" returned: 0 in 0.374s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e384bdf-5c7f-4c3e-b31e-47209ee05256 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bc53399b-52b0-4055-81e2-a1f937af00b5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:45 devstack sudo[88734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bc53399b-52b0-4055-81e2-a1f937af00b5
Nov 05 09:26:45 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:45 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e384bdf-5c7f-4c3e-b31e-47209ee05256 tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bc53399b-52b0-4055-81e2-a1f937af00b5" returned: 0 in 0.272s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2e384bdf-5c7f-4c3e-b31e-47209ee05256 tempest-GroupSnapshotsTest-1107232334 None] Lock "cinder-quobyte-bc53399b-52b0-4055-81e2-a1f937af00b5" released by "delete_volume" :: held 0.693s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:26:45 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-2e384bdf-5c7f-4c3e-b31e-47209ee05256 tempest-GroupSnapshotsTest-1107232334 None] Created reservations ['26dba383-7d4d-4fd6-a0fd-d1a611068821'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:26:45 devstack cinder-volume[86649]: WARNING cinder.quota [None req-2e384bdf-5c7f-4c3e-b31e-47209ee05256 tempest-GroupSnapshotsTest-1107232334 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1498853008 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1498853008, it is now deprecated. Please use the default quota class for default quota.
Nov 05 09:26:45 devstack cinder-volume[86649]: WARNING cinder.quota [None req-2e384bdf-5c7f-4c3e-b31e-47209ee05256 tempest-GroupSnapshotsTest-1107232334 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1498853008 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1498853008, it is now deprecated. Please use the default quota class for default quota.
Nov 05 09:26:45 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-2e384bdf-5c7f-4c3e-b31e-47209ee05256 tempest-GroupSnapshotsTest-1107232334 None] Created reservations ['1d37393f-3814-4d55-b08c-165567ab8b2a', '283964cb-e0f6-4698-ae71-3d84529a5a92', '1a0880dc-7160-422f-b5f3-47d67def5073', '2feb752a-d19d-448a-88e5-290400816a17'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:26:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2e384bdf-5c7f-4c3e-b31e-47209ee05256 tempest-GroupSnapshotsTest-1107232334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:26:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2e384bdf-5c7f-4c3e-b31e-47209ee05256 tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:26:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2e384bdf-5c7f-4c3e-b31e-47209ee05256 tempest-GroupSnapshotsTest-1107232334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:26:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2e384bdf-5c7f-4c3e-b31e-47209ee05256 tempest-GroupSnapshotsTest-1107232334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:26:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2e384bdf-5c7f-4c3e-b31e-47209ee05256 tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:26:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e384bdf-5c7f-4c3e-b31e-47209ee05256 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:45 devstack sudo[88737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:26:45 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:45 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e384bdf-5c7f-4c3e-b31e-47209ee05256 tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.259s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:45 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-2e384bdf-5c7f-4c3e-b31e-47209ee05256 tempest-GroupSnapshotsTest-1107232334 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:26:45 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-2e384bdf-5c7f-4c3e-b31e-47209ee05256 tempest-GroupSnapshotsTest-1107232334 None] Delete group completed successfully.
Nov 05 09:26:46 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-73bb6a77-3ffb-4211-8c9d-5d4a9cb28a54 tempest-GroupSnapshotsTest-1107232334 None] group_snapshot d510fbff-c1b3-4ce0-baa6-49a62f7395fb: deleting
Nov 05 09:26:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-73bb6a77-3ffb-4211-8c9d-5d4a9cb28a54 tempest-GroupSnapshotsTest-1107232334 None] group_snapshot d510fbff-c1b3-4ce0-baa6-49a62f7395fb: deleting {{(pid=86649) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 05 09:26:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-73bb6a77-3ffb-4211-8c9d-5d4a9cb28a54 tempest-GroupSnapshotsTest-1107232334 None] Acquiring lock "cinder-quobyte-927399fc-1462-4e8c-970f-5bf9370c449a" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:26:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-73bb6a77-3ffb-4211-8c9d-5d4a9cb28a54 tempest-GroupSnapshotsTest-1107232334 None] Lock "cinder-quobyte-927399fc-1462-4e8c-970f-5bf9370c449a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:26:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-73bb6a77-3ffb-4211-8c9d-5d4a9cb28a54 tempest-GroupSnapshotsTest-1107232334 None] Acquiring lock "cinder-quobyte-25802fe6-03a7-4207-a015-bbfb43e06486" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:26:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-73bb6a77-3ffb-4211-8c9d-5d4a9cb28a54 tempest-GroupSnapshotsTest-1107232334 None] Lock "cinder-quobyte-25802fe6-03a7-4207-a015-bbfb43e06486" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:26:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-73bb6a77-3ffb-4211-8c9d-5d4a9cb28a54 tempest-GroupSnapshotsTest-1107232334 None] Deleting offline snapshot 25802fe6-03a7-4207-a015-bbfb43e06486 of volume 927399fc-1462-4e8c-970f-5bf9370c449a {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 09:26:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-73bb6a77-3ffb-4211-8c9d-5d4a9cb28a54 tempest-GroupSnapshotsTest-1107232334 None] snapshot_file for this snap is: volume-927399fc-1462-4e8c-970f-5bf9370c449a.25802fe6-03a7-4207-a015-bbfb43e06486 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 09:26:46 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7162573-6aee-4f6f-ad8d-38f8f77ee767]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:26:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-73bb6a77-3ffb-4211-8c9d-5d4a9cb28a54 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a.25802fe6-03a7-4207-a015-bbfb43e06486 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:46 devstack sudo[88740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a.25802fe6-03a7-4207-a015-bbfb43e06486
Nov 05 09:26:46 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:46 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-73bb6a77-3ffb-4211-8c9d-5d4a9cb28a54 tempest-GroupSnapshotsTest-1107232334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a.25802fe6-03a7-4207-a015-bbfb43e06486" returned: 0 in 0.386s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-73bb6a77-3ffb-4211-8c9d-5d4a9cb28a54 tempest-GroupSnapshotsTest-1107232334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-927399fc-1462-4e8c-970f-5bf9370c449a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:26:46 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4312a9-56ce-4ed3-a49b-4afbdbb8de3f]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:26:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-73bb6a77-3ffb-4211-8c9d-5d4a9cb28a54 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:46 devstack sudo[88745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a
Nov 05 09:26:46 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:47 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-73bb6a77-3ffb-4211-8c9d-5d4a9cb28a54 tempest-GroupSnapshotsTest-1107232334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a" returned: 0 in 0.560s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-73bb6a77-3ffb-4211-8c9d-5d4a9cb28a54 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a.25802fe6-03a7-4207-a015-bbfb43e06486 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:47 devstack sudo[88750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a.25802fe6-03a7-4207-a015-bbfb43e06486
Nov 05 09:26:47 devstack sudo[88750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:47 devstack sudo[88750]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-73bb6a77-3ffb-4211-8c9d-5d4a9cb28a54 tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a.25802fe6-03a7-4207-a015-bbfb43e06486" returned: 0 in 0.388s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-73bb6a77-3ffb-4211-8c9d-5d4a9cb28a54 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a.25802fe6-03a7-4207-a015-bbfb43e06486 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:47 devstack sudo[88758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a.25802fe6-03a7-4207-a015-bbfb43e06486
Nov 05 09:26:47 devstack sudo[88758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:47 devstack sudo[88758]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-73bb6a77-3ffb-4211-8c9d-5d4a9cb28a54 tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a.25802fe6-03a7-4207-a015-bbfb43e06486" returned: 0 in 0.290s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-73bb6a77-3ffb-4211-8c9d-5d4a9cb28a54 tempest-GroupSnapshotsTest-1107232334 None] Lock "cinder-quobyte-25802fe6-03a7-4207-a015-bbfb43e06486" released by "_delete_snapshot" :: held 1.738s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:26:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-73bb6a77-3ffb-4211-8c9d-5d4a9cb28a54 tempest-GroupSnapshotsTest-1107232334 None] Lock "cinder-quobyte-927399fc-1462-4e8c-970f-5bf9370c449a" released by "delete_snapshot" :: held 1.762s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:26:47 devstack cinder-volume[86649]: WARNING cinder.quota [None req-73bb6a77-3ffb-4211-8c9d-5d4a9cb28a54 tempest-GroupSnapshotsTest-1107232334 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1498853008 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1498853008, it is now deprecated. Please use the default quota class for default quota.
Nov 05 09:26:47 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-73bb6a77-3ffb-4211-8c9d-5d4a9cb28a54 tempest-GroupSnapshotsTest-1107232334 None] Created reservations ['b75bb076-262f-44f3-be6f-a8b312c417a4', 'fdf069f6-0748-4f2f-a0e7-869b3996fab8', 'e54c263e-c4ed-43d2-a31f-d3d652954ea1', 'e8f4301a-9837-4715-8d28-42ae240a31b2'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:26:48 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-73bb6a77-3ffb-4211-8c9d-5d4a9cb28a54 tempest-GroupSnapshotsTest-1107232334 None] group_snapshot d510fbff-c1b3-4ce0-baa6-49a62f7395fb: deleted successfully
Nov 05 09:26:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ab7ebc5f-fa79-49d2-81b4-8a8ee46faa3a tempest-GroupSnapshotsTest-1107232334 None] Acquiring lock "cinder-quobyte-927399fc-1462-4e8c-970f-5bf9370c449a" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:26:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ab7ebc5f-fa79-49d2-81b4-8a8ee46faa3a tempest-GroupSnapshotsTest-1107232334 None] Lock "cinder-quobyte-927399fc-1462-4e8c-970f-5bf9370c449a" acquired by "delete_volume" :: waited 0.040s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:26:48 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccad9290-fcda-4da6-8007-3e1ef99cb228]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:26:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ab7ebc5f-fa79-49d2-81b4-8a8ee46faa3a tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:48 devstack sudo[88765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a
Nov 05 09:26:48 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:49 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ab7ebc5f-fa79-49d2-81b4-8a8ee46faa3a tempest-GroupSnapshotsTest-1107232334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a" returned: 0 in 0.444s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ab7ebc5f-fa79-49d2-81b4-8a8ee46faa3a tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:49 devstack sudo[88770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a
Nov 05 09:26:49 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:49 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ab7ebc5f-fa79-49d2-81b4-8a8ee46faa3a tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-927399fc-1462-4e8c-970f-5bf9370c449a" returned: 0 in 0.250s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ab7ebc5f-fa79-49d2-81b4-8a8ee46faa3a tempest-GroupSnapshotsTest-1107232334 None] Lock "cinder-quobyte-927399fc-1462-4e8c-970f-5bf9370c449a" released by "delete_volume" :: held 0.807s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:26:49 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-ab7ebc5f-fa79-49d2-81b4-8a8ee46faa3a tempest-GroupSnapshotsTest-1107232334 None] Created reservations ['0c4e777b-8a41-4973-aba8-6f758430e5fe'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:26:49 devstack cinder-volume[86649]: WARNING cinder.db.api [None req-ab7ebc5f-fa79-49d2-81b4-8a8ee46faa3a tempest-GroupSnapshotsTest-1107232334 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1498853008']
Nov 05 09:26:49 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-ab7ebc5f-fa79-49d2-81b4-8a8ee46faa3a tempest-GroupSnapshotsTest-1107232334 None] Created reservations ['3ea55749-0d93-4f48-9746-592df1ec8300', 'b5a4e9a9-86f5-4dc4-8749-6119cd21c471', '60e94fa0-637e-4046-aa6a-760df4ef12c3', 'bb133412-9506-4018-903c-36e9d7473398'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:26:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ab7ebc5f-fa79-49d2-81b4-8a8ee46faa3a tempest-GroupSnapshotsTest-1107232334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:26:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ab7ebc5f-fa79-49d2-81b4-8a8ee46faa3a tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:26:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ab7ebc5f-fa79-49d2-81b4-8a8ee46faa3a tempest-GroupSnapshotsTest-1107232334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:26:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ab7ebc5f-fa79-49d2-81b4-8a8ee46faa3a tempest-GroupSnapshotsTest-1107232334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:26:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ab7ebc5f-fa79-49d2-81b4-8a8ee46faa3a tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:26:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ab7ebc5f-fa79-49d2-81b4-8a8ee46faa3a tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:49 devstack sudo[88773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:26:49 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:50 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ab7ebc5f-fa79-49d2-81b4-8a8ee46faa3a tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.252s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:50 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-ab7ebc5f-fa79-49d2-81b4-8a8ee46faa3a tempest-GroupSnapshotsTest-1107232334 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:26:50 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ab7ebc5f-fa79-49d2-81b4-8a8ee46faa3a tempest-GroupSnapshotsTest-1107232334 None] Delete group completed successfully.
Nov 05 09:26:50 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-a6690f2f-ba9b-462f-bcb0-e2db32745c2e tempest-GroupSnapshotsTest-1107232334 None] Group tempest-GroupSnapshotsTest-Group-1350110063: creating
Nov 05 09:26:50 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-a6690f2f-ba9b-462f-bcb0-e2db32745c2e tempest-GroupSnapshotsTest-1107232334 None] Group tempest-GroupSnapshotsTest-Group-1350110063: created successfully
Nov 05 09:26:50 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-a6690f2f-ba9b-462f-bcb0-e2db32745c2e tempest-GroupSnapshotsTest-1107232334 None] Create group completed successfully.
Nov 05 09:26:52 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:26:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] Flow 'volume_create_manager' (1551ded3-41a0-4829-ad57-0f8aff2ca953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:26:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a319c3ca-62e9-4d13-b628-50f7e70afa52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a319c3ca-62e9-4d13-b628-50f7e70afa52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-91245924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=41b746fe-e804-4ca2-abaa-b24b3d3a7b98,host='devstack@QuobyteHD#QuobyteHD',id=08d8ab4a-d799-453d-8ba4-e0fca1a8f763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f67818608c8a473782469282b0687832',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:26:52Z,use_quota=True,user_id='1f634e8c23a94774b7be18328e509609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7713b2ff-858c-4aa9-a57d-c3dd353c4001),volume_type_id=7713b2ff-858c-4aa9-a57d-c3dd353c4001)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2329d660-5029-4b82-90f1-baff73b9f766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2329d660-5029-4b82-90f1-baff73b9f766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c910c54d-0c73-456b-b25c-96907b6656c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c910c54d-0c73-456b-b25c-96907b6656c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08d8ab4a-d799-453d-8ba4-e0fca1a8f763', 'volume_name': 'volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f4c0a7f-347c-4002-88bc-7ca3f3e49728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f4c0a7f-347c-4002-88bc-7ca3f3e49728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66b6730-1ef4-4e0a-9e59-1fe06dc94092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:52 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] Volume 08d8ab4a-d799-453d-8ba4-e0fca1a8f763: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763', 'volume_size': 1}
Nov 05 09:26:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:26:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:26:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=41b746fe-e804-4ca2-abaa-b24b3d3a7b98,created_at=2026-11-05T08:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-91245924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=41b746fe-e804-4ca2-abaa-b24b3d3a7b98,host='devstack@QuobyteHD#QuobyteHD',id=08d8ab4a-d799-453d-8ba4-e0fca1a8f763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f67818608c8a473782469282b0687832',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:26:52Z,use_quota=True,user_id='1f634e8c23a94774b7be18328e509609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7713b2ff-858c-4aa9-a57d-c3dd353c4001),volume_type_id=7713b2ff-858c-4aa9-a57d-c3dd353c4001)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:26:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] Creating volume 08d8ab4a-d799-453d-8ba4-e0fca1a8f763 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:26:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:26:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:26:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:26:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:26:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:26:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:26:52 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:26:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:52 devstack sudo[88778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763 1073741824
Nov 05 09:26:52 devstack sudo[88778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:52 devstack sudo[88778]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763 1073741824" returned: 0 in 0.624s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:52 devstack sudo[88792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763
Nov 05 09:26:52 devstack sudo[88792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:53 devstack sudo[88792]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763" returned: 0 in 0.310s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:26:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:26:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66b6730-1ef4-4e0a-9e59-1fe06dc94092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a16a8077-5fbc-45ce-8d2e-6b9a531fe972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:53 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] Volume volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763 (08d8ab4a-d799-453d-8ba4-e0fca1a8f763): created successfully
Nov 05 09:26:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a16a8077-5fbc-45ce-8d2e-6b9a531fe972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] Flow 'volume_create_manager' (1551ded3-41a0-4829-ad57-0f8aff2ca953) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:26:53 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-98487709-4a72-482e-9939-1ef8bbb93082 tempest-GroupSnapshotsTest-1107232334 None] Created volume successfully.
Nov 05 09:26:55 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:26:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] Flow 'volume_create_manager' (e04d1b29-1604-495e-b2fa-443bb0c48b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:26:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cc232ea-fdd2-45ab-8d1e-02db0445d371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cc232ea-fdd2-45ab-8d1e-02db0445d371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-820328897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=41b746fe-e804-4ca2-abaa-b24b3d3a7b98,host='devstack@QuobyteHD#QuobyteHD',id=49316564-956c-45f4-9252-3439e2ce82c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f67818608c8a473782469282b0687832',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:26:55Z,use_quota=True,user_id='1f634e8c23a94774b7be18328e509609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7713b2ff-858c-4aa9-a57d-c3dd353c4001),volume_type_id=7713b2ff-858c-4aa9-a57d-c3dd353c4001)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dad64395-0c99-4cc9-b609-219863dac82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dad64395-0c99-4cc9-b609-219863dac82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08af39e0-b4a7-4147-a7cf-a7ca7a52d01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08af39e0-b4a7-4147-a7cf-a7ca7a52d01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49316564-956c-45f4-9252-3439e2ce82c4', 'volume_name': 'volume-49316564-956c-45f4-9252-3439e2ce82c4', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a35f3ae-32b6-46c8-ae45-3ed975175b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a35f3ae-32b6-46c8-ae45-3ed975175b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d2c527-c4bf-4836-9457-3eb55f639477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:55 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] Volume 49316564-956c-45f4-9252-3439e2ce82c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49316564-956c-45f4-9252-3439e2ce82c4', 'volume_size': 1}
Nov 05 09:26:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:26:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:26:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=41b746fe-e804-4ca2-abaa-b24b3d3a7b98,created_at=2026-11-05T08:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-820328897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=41b746fe-e804-4ca2-abaa-b24b3d3a7b98,host='devstack@QuobyteHD#QuobyteHD',id=49316564-956c-45f4-9252-3439e2ce82c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f67818608c8a473782469282b0687832',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:26:55Z,use_quota=True,user_id='1f634e8c23a94774b7be18328e509609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7713b2ff-858c-4aa9-a57d-c3dd353c4001),volume_type_id=7713b2ff-858c-4aa9-a57d-c3dd353c4001)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:26:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] Creating volume 49316564-956c-45f4-9252-3439e2ce82c4 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:26:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:26:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:26:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:26:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:26:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:26:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:26:55 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:26:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:55 devstack sudo[88802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4 1073741824
Nov 05 09:26:55 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:55 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4 1073741824" returned: 0 in 0.490s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:26:55 devstack sudo[88808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4
Nov 05 09:26:55 devstack sudo[88808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:26:55 devstack sudo[88808]: pam_unix(sudo:session): session closed for user root
Nov 05 09:26:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4" returned: 0 in 0.257s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:26:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:26:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:26:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d2c527-c4bf-4836-9457-3eb55f639477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49316564-956c-45f4-9252-3439e2ce82c4', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d784da9-a9a6-42dd-ba48-2b57b2fea73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:26:56 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] Volume volume-49316564-956c-45f4-9252-3439e2ce82c4 (49316564-956c-45f4-9252-3439e2ce82c4): created successfully
Nov 05 09:26:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d784da9-a9a6-42dd-ba48-2b57b2fea73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:26:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] Flow 'volume_create_manager' (e04d1b29-1604-495e-b2fa-443bb0c48b13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:26:56 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-247830fb-f7b0-4305-8a4d-87132d04fca5 tempest-GroupSnapshotsTest-1107232334 None] Created volume successfully.
Nov 05 09:26:56 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-e5d0e78e-5e0b-47c8-93ae-02e8bcf27b64 tempest-GroupSnapshotsTest-1107232334 None] Update group completed successfully.
Nov 05 09:26:57 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-50838db3-63a3-4e7e-bbb6-a0c4601724d8 tempest-GroupSnapshotsTest-1107232334 None] Update group completed successfully.
Nov 05 09:26:58 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-54d25887-07ef-430c-acba-20755cacabd3 tempest-GroupSnapshotsTest-1107232334 None] Update group completed successfully.
Nov 05 09:27:00 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-bede566c-3c6e-4400-8521-09277daf68d5 tempest-GroupSnapshotsTest-1107232334 None] Update group completed successfully.
Nov 05 09:27:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:27:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:27:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:27:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:27:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:27:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:27:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:00 devstack sudo[88812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:27:00 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:00 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.260s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:27:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:27:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 8 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:27:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:27:01 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] GroupSnapshot ca185f69-02b4-4493-8ded-768233cb24be: creating.
Nov 05 09:27:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] Group snapshot ca185f69-02b4-4493-8ded-768233cb24be: creating. {{(pid=86649) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 05 09:27:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:27:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:27:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] Creating offline snapshot b0f68056-ff51-406a-b398-fdefb566d14f of volume 08d8ab4a-d799-453d-8ba4-e0fca1a8f763 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 09:27:01 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e24757b-a30d-4001-8aa8-76f10b56bdff]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:27:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:01 devstack sudo[88815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763
Nov 05 09:27:01 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:02 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763" returned: 0 in 0.372s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763.b0f68056-ff51-406a-b398-fdefb566d14f 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:02 devstack sudo[88820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763.b0f68056-ff51-406a-b398-fdefb566d14f 1G
Nov 05 09:27:02 devstack sudo[88820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:02 devstack sudo[88820]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763.b0f68056-ff51-406a-b398-fdefb566d14f 1G" returned: 0 in 0.488s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763.b0f68056-ff51-406a-b398-fdefb566d14f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:02 devstack sudo[88826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763.b0f68056-ff51-406a-b398-fdefb566d14f
Nov 05 09:27:02 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:02 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763.b0f68056-ff51-406a-b398-fdefb566d14f" returned: 0 in 0.324s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:02 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763.b0f68056-ff51-406a-b398-fdefb566d14f is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 09:27:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763.b0f68056-ff51-406a-b398-fdefb566d14f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:02 devstack sudo[88831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763.b0f68056-ff51-406a-b398-fdefb566d14f
Nov 05 09:27:02 devstack sudo[88831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:03 devstack sudo[88831]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763.b0f68056-ff51-406a-b398-fdefb566d14f" returned: 0 in 0.261s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:03 devstack sudo[88834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763.info
Nov 05 09:27:03 devstack sudo[88834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:03 devstack sudo[88834]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763.info" returned: 0 in 0.266s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:03 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 09:27:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:03 devstack sudo[88837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763.info
Nov 05 09:27:03 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:03 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763.info" returned: 0 in 0.259s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.071s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:27:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:27:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:27:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] Creating offline snapshot c3fd354f-63d1-4e02-ab43-f99068f30ec7 of volume 49316564-956c-45f4-9252-3439e2ce82c4 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 09:27:03 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6d9831-42ef-4bdd-a7f8-2d2a684821b8]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:27:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:03 devstack sudo[88840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4
Nov 05 09:27:03 devstack sudo[88840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:04 devstack sudo[88840]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4" returned: 0 in 0.446s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4.c3fd354f-63d1-4e02-ab43-f99068f30ec7 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:04 devstack sudo[88847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4.c3fd354f-63d1-4e02-ab43-f99068f30ec7 1G
Nov 05 09:27:04 devstack sudo[88847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:04 devstack sudo[88847]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4.c3fd354f-63d1-4e02-ab43-f99068f30ec7 1G" returned: 0 in 0.494s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49316564-956c-45f4-9252-3439e2ce82c4 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4.c3fd354f-63d1-4e02-ab43-f99068f30ec7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:04 devstack sudo[88853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49316564-956c-45f4-9252-3439e2ce82c4 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4.c3fd354f-63d1-4e02-ab43-f99068f30ec7
Nov 05 09:27:04 devstack sudo[88853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:05 devstack sudo[88853]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49316564-956c-45f4-9252-3439e2ce82c4 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4.c3fd354f-63d1-4e02-ab43-f99068f30ec7" returned: 0 in 0.364s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:05 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4.c3fd354f-63d1-4e02-ab43-f99068f30ec7 is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 09:27:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4.c3fd354f-63d1-4e02-ab43-f99068f30ec7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:05 devstack sudo[88858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4.c3fd354f-63d1-4e02-ab43-f99068f30ec7
Nov 05 09:27:05 devstack sudo[88858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:05 devstack sudo[88858]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4.c3fd354f-63d1-4e02-ab43-f99068f30ec7" returned: 0 in 0.269s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:05 devstack sudo[88861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4.info
Nov 05 09:27:05 devstack sudo[88861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:05 devstack sudo[88861]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4.info" returned: 0 in 0.269s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:05 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 09:27:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:05 devstack sudo[88864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4.info
Nov 05 09:27:05 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:05 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4.info" returned: 0 in 0.263s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.201s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:27:06 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-e0047149-38f2-48f6-86a1-1bfb6ca38e6f tempest-GroupSnapshotsTest-1107232334 None] group_snapshot ca185f69-02b4-4493-8ded-768233cb24be: created successfully
Nov 05 09:27:07 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] group_snapshot ca185f69-02b4-4493-8ded-768233cb24be: deleting
Nov 05 09:27:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] group_snapshot ca185f69-02b4-4493-8ded-768233cb24be: deleting {{(pid=86649) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 05 09:27:07 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] Acquiring lock "cinder-quobyte-08d8ab4a-d799-453d-8ba4-e0fca1a8f763" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:27:07 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] Lock "cinder-quobyte-08d8ab4a-d799-453d-8ba4-e0fca1a8f763" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:27:07 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] Acquiring lock "cinder-quobyte-b0f68056-ff51-406a-b398-fdefb566d14f" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:27:07 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] Lock "cinder-quobyte-b0f68056-ff51-406a-b398-fdefb566d14f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:27:07 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] Deleting offline snapshot b0f68056-ff51-406a-b398-fdefb566d14f of volume 08d8ab4a-d799-453d-8ba4-e0fca1a8f763 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 09:27:07 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] snapshot_file for this snap is: volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763.b0f68056-ff51-406a-b398-fdefb566d14f {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 09:27:07 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d29971d-9202-493b-a985-6eb798dc202c]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:27:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763.b0f68056-ff51-406a-b398-fdefb566d14f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:07 devstack sudo[88867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763.b0f68056-ff51-406a-b398-fdefb566d14f
Nov 05 09:27:07 devstack sudo[88867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:07 devstack sudo[88867]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763.b0f68056-ff51-406a-b398-fdefb566d14f" returned: 0 in 0.384s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:07 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:27:07 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd92baf-4ff5-42ee-9766-a96bd229d6a7]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:27:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:07 devstack sudo[88872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763
Nov 05 09:27:07 devstack sudo[88872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:07 devstack sudo[88872]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763" returned: 0 in 0.379s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763.b0f68056-ff51-406a-b398-fdefb566d14f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:08 devstack sudo[88877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763.b0f68056-ff51-406a-b398-fdefb566d14f
Nov 05 09:27:08 devstack sudo[88877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:08 devstack sudo[88877]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763.b0f68056-ff51-406a-b398-fdefb566d14f" returned: 0 in 0.423s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763.b0f68056-ff51-406a-b398-fdefb566d14f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:08 devstack sudo[88883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763.b0f68056-ff51-406a-b398-fdefb566d14f
Nov 05 09:27:08 devstack sudo[88883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:08 devstack sudo[88883]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763.b0f68056-ff51-406a-b398-fdefb566d14f" returned: 0 in 0.286s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] Lock "cinder-quobyte-b0f68056-ff51-406a-b398-fdefb566d14f" released by "_delete_snapshot" :: held 1.620s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:27:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] Lock "cinder-quobyte-08d8ab4a-d799-453d-8ba4-e0fca1a8f763" released by "delete_snapshot" :: held 1.646s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:27:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] Acquiring lock "cinder-quobyte-49316564-956c-45f4-9252-3439e2ce82c4" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:27:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] Lock "cinder-quobyte-49316564-956c-45f4-9252-3439e2ce82c4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:27:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] Acquiring lock "cinder-quobyte-c3fd354f-63d1-4e02-ab43-f99068f30ec7" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:27:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] Lock "cinder-quobyte-c3fd354f-63d1-4e02-ab43-f99068f30ec7" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:27:08 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] Deleting offline snapshot c3fd354f-63d1-4e02-ab43-f99068f30ec7 of volume 49316564-956c-45f4-9252-3439e2ce82c4 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 09:27:08 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] snapshot_file for this snap is: volume-49316564-956c-45f4-9252-3439e2ce82c4.c3fd354f-63d1-4e02-ab43-f99068f30ec7 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 09:27:08 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[cead1e47-3db2-4fd7-a6c6-c7a7a9f6b21a]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:27:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4.c3fd354f-63d1-4e02-ab43-f99068f30ec7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:09 devstack sudo[88886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4.c3fd354f-63d1-4e02-ab43-f99068f30ec7
Nov 05 09:27:09 devstack sudo[88886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:09 devstack sudo[88886]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4.c3fd354f-63d1-4e02-ab43-f99068f30ec7" returned: 0 in 0.443s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49316564-956c-45f4-9252-3439e2ce82c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:27:09 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[2103338b-d7b0-4aad-ae9f-da72bb92b155]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:27:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:09 devstack sudo[88892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4
Nov 05 09:27:09 devstack sudo[88892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:09 devstack sudo[88892]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4" returned: 0 in 0.468s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4.c3fd354f-63d1-4e02-ab43-f99068f30ec7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:09 devstack sudo[88898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4.c3fd354f-63d1-4e02-ab43-f99068f30ec7
Nov 05 09:27:09 devstack sudo[88898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:10 devstack sudo[88898]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4.c3fd354f-63d1-4e02-ab43-f99068f30ec7" returned: 0 in 0.422s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4.c3fd354f-63d1-4e02-ab43-f99068f30ec7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:10 devstack sudo[88904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4.c3fd354f-63d1-4e02-ab43-f99068f30ec7
Nov 05 09:27:10 devstack sudo[88904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:10 devstack sudo[88904]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4.c3fd354f-63d1-4e02-ab43-f99068f30ec7" returned: 0 in 0.311s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] Lock "cinder-quobyte-c3fd354f-63d1-4e02-ab43-f99068f30ec7" released by "_delete_snapshot" :: held 1.849s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:27:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] Lock "cinder-quobyte-49316564-956c-45f4-9252-3439e2ce82c4" released by "delete_snapshot" :: held 1.891s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:27:10 devstack cinder-volume[86649]: WARNING cinder.quota [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1791963396 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1791963396, it is now deprecated. Please use the default quota class for default quota.
Nov 05 09:27:10 devstack cinder-volume[86649]: WARNING cinder.quota [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1791963396 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1791963396, it is now deprecated. Please use the default quota class for default quota.
Nov 05 09:27:10 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] Created reservations ['46f3460a-eb02-4a00-af9f-8236ed19905d', 'f62ff1d8-ac70-42ef-9116-17d309371424', 'b406f639-23ec-4870-985a-ac919f30bcea', 'b45d38e7-c04c-4d51-9413-4cf3c9bf4f5b'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:27:10 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] Created reservations ['5eb95e14-d6d0-4e10-b682-c7edd1129d68', 'fce6e0b5-76b0-4751-a957-9b84e348f84e', 'b8dcd46e-0ec8-4cc1-a1ae-4511b69c4cd7', '56fa00f5-7448-4a4e-a76e-8c06bc586e99'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:27:10 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-cc63787d-907c-4e1a-81c4-32a5c0824d68 tempest-GroupSnapshotsTest-1107232334 None] group_snapshot ca185f69-02b4-4493-8ded-768233cb24be: deleted successfully
Nov 05 09:27:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a4f5b94c-46be-44e5-bd66-ab679d40fc84 tempest-GroupSnapshotsTest-1107232334 None] Acquiring lock "cinder-quobyte-08d8ab4a-d799-453d-8ba4-e0fca1a8f763" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:27:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a4f5b94c-46be-44e5-bd66-ab679d40fc84 tempest-GroupSnapshotsTest-1107232334 None] Lock "cinder-quobyte-08d8ab4a-d799-453d-8ba4-e0fca1a8f763" acquired by "delete_volume" :: waited 0.026s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:27:12 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fc57ce-630e-4cb3-8c1a-b5cacf252d5a]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:27:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a4f5b94c-46be-44e5-bd66-ab679d40fc84 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:12 devstack sudo[88912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763
Nov 05 09:27:12 devstack sudo[88912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:12 devstack sudo[88912]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a4f5b94c-46be-44e5-bd66-ab679d40fc84 tempest-GroupSnapshotsTest-1107232334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763" returned: 0 in 0.517s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a4f5b94c-46be-44e5-bd66-ab679d40fc84 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:12 devstack sudo[88918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763
Nov 05 09:27:12 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:12 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a4f5b94c-46be-44e5-bd66-ab679d40fc84 tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-08d8ab4a-d799-453d-8ba4-e0fca1a8f763" returned: 0 in 0.317s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:13 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a4f5b94c-46be-44e5-bd66-ab679d40fc84 tempest-GroupSnapshotsTest-1107232334 None] Lock "cinder-quobyte-08d8ab4a-d799-453d-8ba4-e0fca1a8f763" released by "delete_volume" :: held 0.938s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:27:13 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a4f5b94c-46be-44e5-bd66-ab679d40fc84 tempest-GroupSnapshotsTest-1107232334 None] Acquiring lock "cinder-quobyte-49316564-956c-45f4-9252-3439e2ce82c4" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:27:13 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a4f5b94c-46be-44e5-bd66-ab679d40fc84 tempest-GroupSnapshotsTest-1107232334 None] Lock "cinder-quobyte-49316564-956c-45f4-9252-3439e2ce82c4" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:27:13 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1f4510-f9e0-4ba4-a9c0-bda3cc4e1788]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:27:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a4f5b94c-46be-44e5-bd66-ab679d40fc84 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:13 devstack sudo[88923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4
Nov 05 09:27:13 devstack sudo[88923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:13 devstack sudo[88923]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a4f5b94c-46be-44e5-bd66-ab679d40fc84 tempest-GroupSnapshotsTest-1107232334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4" returned: 0 in 0.550s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a4f5b94c-46be-44e5-bd66-ab679d40fc84 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:13 devstack sudo[88929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4
Nov 05 09:27:13 devstack sudo[88929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:13 devstack sudo[88929]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a4f5b94c-46be-44e5-bd66-ab679d40fc84 tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49316564-956c-45f4-9252-3439e2ce82c4" returned: 0 in 0.301s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:14 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a4f5b94c-46be-44e5-bd66-ab679d40fc84 tempest-GroupSnapshotsTest-1107232334 None] Lock "cinder-quobyte-49316564-956c-45f4-9252-3439e2ce82c4" released by "delete_volume" :: held 0.976s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:27:14 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-a4f5b94c-46be-44e5-bd66-ab679d40fc84 tempest-GroupSnapshotsTest-1107232334 None] Created reservations ['9b2ba5cb-576e-4775-a277-8248f820ef5e'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:27:14 devstack cinder-volume[86649]: WARNING cinder.quota [None req-a4f5b94c-46be-44e5-bd66-ab679d40fc84 tempest-GroupSnapshotsTest-1107232334 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1791963396 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1791963396, it is now deprecated. Please use the default quota class for default quota.
Nov 05 09:27:14 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-a4f5b94c-46be-44e5-bd66-ab679d40fc84 tempest-GroupSnapshotsTest-1107232334 None] Created reservations ['32792c83-c58f-402e-8dcc-1bdf4f94e3fe', '2cec7ae9-35ac-4c47-a667-798f6d696252', '4ebe6538-7d97-4f29-9c57-9afea77fec47', '34cd1731-ea16-407d-a011-623a85fc38a4'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:27:14 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-a4f5b94c-46be-44e5-bd66-ab679d40fc84 tempest-GroupSnapshotsTest-1107232334 None] Created reservations ['b7f65960-bc73-4e2c-b141-5a2f3d1b7cdc', '7fc333e6-9472-4f87-8067-5059ad5d7daf', '802b5fcd-1336-4146-b682-4c952560d890', 'f68d4247-c609-42a3-a2a3-c504620b035b'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:27:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a4f5b94c-46be-44e5-bd66-ab679d40fc84 tempest-GroupSnapshotsTest-1107232334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:27:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a4f5b94c-46be-44e5-bd66-ab679d40fc84 tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:27:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5b94c-46be-44e5-bd66-ab679d40fc84 tempest-GroupSnapshotsTest-1107232334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:27:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a4f5b94c-46be-44e5-bd66-ab679d40fc84 tempest-GroupSnapshotsTest-1107232334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:27:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a4f5b94c-46be-44e5-bd66-ab679d40fc84 tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:27:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a4f5b94c-46be-44e5-bd66-ab679d40fc84 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:14 devstack sudo[88948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:27:14 devstack sudo[88948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:14 devstack sudo[88948]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a4f5b94c-46be-44e5-bd66-ab679d40fc84 tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.280s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:14 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-a4f5b94c-46be-44e5-bd66-ab679d40fc84 tempest-GroupSnapshotsTest-1107232334 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:27:14 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-a4f5b94c-46be-44e5-bd66-ab679d40fc84 tempest-GroupSnapshotsTest-1107232334 None] Delete group completed successfully.
Nov 05 09:27:15 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-a382d099-c3a0-4232-9071-13ee638b2cb3 tempest-GroupSnapshotsTest-1107232334 None] Group tempest-GroupSnapshotsTest-Group-749529383: creating
Nov 05 09:27:15 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-a382d099-c3a0-4232-9071-13ee638b2cb3 tempest-GroupSnapshotsTest-1107232334 None] Group tempest-GroupSnapshotsTest-Group-749529383: created successfully
Nov 05 09:27:15 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-a382d099-c3a0-4232-9071-13ee638b2cb3 tempest-GroupSnapshotsTest-1107232334 None] Create group completed successfully.
Nov 05 09:27:16 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:27:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] Flow 'volume_create_manager' (c28e9a8a-4772-4eeb-b743-200cb6b61f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:27:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (824e6fb8-2475-43fe-b5dd-3ae8eea22724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:27:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (824e6fb8-2475-43fe-b5dd-3ae8eea22724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-91601157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6a070331-3594-469b-b328-fa5500e75f3e,host='devstack@QuobyteHD#QuobyteHD',id=ab0f1598-6f65-46c2-aa92-f68203fd0a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f67818608c8a473782469282b0687832',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:27:17Z,use_quota=True,user_id='1f634e8c23a94774b7be18328e509609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd36edc4-aacf-4119-8518-bc8b23d890b7),volume_type_id=bd36edc4-aacf-4119-8518-bc8b23d890b7)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:27:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5538e590-4d2e-4156-8e22-6fbc4e2a1a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:27:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5538e590-4d2e-4156-8e22-6fbc4e2a1a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:27:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25f6c2ee-3633-4d44-a676-3d8a0b682dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:27:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25f6c2ee-3633-4d44-a676-3d8a0b682dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab0f1598-6f65-46c2-aa92-f68203fd0a19', 'volume_name': 'volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:27:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81563406-01bd-4457-85b7-5dba9a847202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:27:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81563406-01bd-4457-85b7-5dba9a847202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:27:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04fe3413-e4d4-4f2c-a199-ddaf5a6e56e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:27:16 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] Volume ab0f1598-6f65-46c2-aa92-f68203fd0a19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19', 'volume_size': 1}
Nov 05 09:27:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:27:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:27:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6a070331-3594-469b-b328-fa5500e75f3e,created_at=2026-11-05T08:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-91601157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6a070331-3594-469b-b328-fa5500e75f3e,host='devstack@QuobyteHD#QuobyteHD',id=ab0f1598-6f65-46c2-aa92-f68203fd0a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f67818608c8a473782469282b0687832',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:27:17Z,use_quota=True,user_id='1f634e8c23a94774b7be18328e509609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd36edc4-aacf-4119-8518-bc8b23d890b7),volume_type_id=bd36edc4-aacf-4119-8518-bc8b23d890b7)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:27:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] Creating volume ab0f1598-6f65-46c2-aa92-f68203fd0a19 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:27:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:27:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:27:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:27:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:27:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:27:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:27:16 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:27:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:16 devstack sudo[88952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19 1073741824
Nov 05 09:27:16 devstack sudo[88952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:17 devstack sudo[88952]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19 1073741824" returned: 0 in 0.452s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:17 devstack sudo[88958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19
Nov 05 09:27:17 devstack sudo[88958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:17 devstack sudo[88958]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19" returned: 0 in 0.287s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:27:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:27:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04fe3413-e4d4-4f2c-a199-ddaf5a6e56e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:27:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e97e6d5b-3904-4e8e-9201-12453d6da06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:27:17 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] Volume volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19 (ab0f1598-6f65-46c2-aa92-f68203fd0a19): created successfully
Nov 05 09:27:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e97e6d5b-3904-4e8e-9201-12453d6da06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:27:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] Flow 'volume_create_manager' (c28e9a8a-4772-4eeb-b743-200cb6b61f40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:27:17 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-e963fa77-b5be-4112-88cb-93058e76bb3b tempest-GroupSnapshotsTest-1107232334 None] Created volume successfully.
Nov 05 09:27:18 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ff59c8be-8d66-4004-8f17-1191bf25d864 tempest-GroupSnapshotsTest-1107232334 None] GroupSnapshot ca6f649d-c217-4196-9a51-736ba258acb5: creating.
Nov 05 09:27:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ff59c8be-8d66-4004-8f17-1191bf25d864 tempest-GroupSnapshotsTest-1107232334 None] Group snapshot ca6f649d-c217-4196-9a51-736ba258acb5: creating. {{(pid=86649) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 05 09:27:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ff59c8be-8d66-4004-8f17-1191bf25d864 tempest-GroupSnapshotsTest-1107232334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:27:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ff59c8be-8d66-4004-8f17-1191bf25d864 tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:27:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-ff59c8be-8d66-4004-8f17-1191bf25d864 tempest-GroupSnapshotsTest-1107232334 None] Creating offline snapshot 7b4c8378-2465-4375-96f1-fc9bba46910d of volume ab0f1598-6f65-46c2-aa92-f68203fd0a19 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 09:27:18 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a181cc-5899-4130-b8ed-5037a73e833f]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:27:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff59c8be-8d66-4004-8f17-1191bf25d864 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:18 devstack sudo[88962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19
Nov 05 09:27:18 devstack sudo[88962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:18 devstack sudo[88962]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff59c8be-8d66-4004-8f17-1191bf25d864 tempest-GroupSnapshotsTest-1107232334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19" returned: 0 in 0.400s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff59c8be-8d66-4004-8f17-1191bf25d864 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19.7b4c8378-2465-4375-96f1-fc9bba46910d 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:18 devstack sudo[88967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19.7b4c8378-2465-4375-96f1-fc9bba46910d 1G
Nov 05 09:27:18 devstack sudo[88967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:19 devstack sudo[88967]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff59c8be-8d66-4004-8f17-1191bf25d864 tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19.7b4c8378-2465-4375-96f1-fc9bba46910d 1G" returned: 0 in 0.409s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff59c8be-8d66-4004-8f17-1191bf25d864 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19.7b4c8378-2465-4375-96f1-fc9bba46910d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:19 devstack sudo[88973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19.7b4c8378-2465-4375-96f1-fc9bba46910d
Nov 05 09:27:19 devstack sudo[88973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:19 devstack sudo[88973]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff59c8be-8d66-4004-8f17-1191bf25d864 tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19.7b4c8378-2465-4375-96f1-fc9bba46910d" returned: 0 in 0.304s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:19 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-ff59c8be-8d66-4004-8f17-1191bf25d864 tempest-GroupSnapshotsTest-1107232334 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19.7b4c8378-2465-4375-96f1-fc9bba46910d is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 09:27:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff59c8be-8d66-4004-8f17-1191bf25d864 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19.7b4c8378-2465-4375-96f1-fc9bba46910d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:19 devstack sudo[88978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19.7b4c8378-2465-4375-96f1-fc9bba46910d
Nov 05 09:27:19 devstack sudo[88978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:19 devstack sudo[88978]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff59c8be-8d66-4004-8f17-1191bf25d864 tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19.7b4c8378-2465-4375-96f1-fc9bba46910d" returned: 0 in 0.311s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff59c8be-8d66-4004-8f17-1191bf25d864 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:19 devstack sudo[88981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19.info
Nov 05 09:27:19 devstack sudo[88981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:20 devstack sudo[88981]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff59c8be-8d66-4004-8f17-1191bf25d864 tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19.info" returned: 0 in 0.286s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:20 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-ff59c8be-8d66-4004-8f17-1191bf25d864 tempest-GroupSnapshotsTest-1107232334 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 09:27:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff59c8be-8d66-4004-8f17-1191bf25d864 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:20 devstack sudo[88984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19.info
Nov 05 09:27:20 devstack sudo[88984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:20 devstack sudo[88984]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff59c8be-8d66-4004-8f17-1191bf25d864 tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19.info" returned: 0 in 0.251s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ff59c8be-8d66-4004-8f17-1191bf25d864 tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.061s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:27:20 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ff59c8be-8d66-4004-8f17-1191bf25d864 tempest-GroupSnapshotsTest-1107232334 None] group_snapshot ca6f649d-c217-4196-9a51-736ba258acb5: created successfully
Nov 05 09:27:21 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-1e5feab9-bc7a-462a-ad1f-893bcf3e3577 tempest-GroupSnapshotsTest-1107232334 None] group_snapshot ca6f649d-c217-4196-9a51-736ba258acb5: deleting
Nov 05 09:27:21 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=109,cinder:UPDATE=105,cinder:INSERT=25,cinder:DELETE=2 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:27:21 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=111,cinder:UPDATE=95,cinder:DELETE=4,cinder:INSERT=20 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:27:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1e5feab9-bc7a-462a-ad1f-893bcf3e3577 tempest-GroupSnapshotsTest-1107232334 None] group_snapshot ca6f649d-c217-4196-9a51-736ba258acb5: deleting {{(pid=86649) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 05 09:27:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1e5feab9-bc7a-462a-ad1f-893bcf3e3577 tempest-GroupSnapshotsTest-1107232334 None] Acquiring lock "cinder-quobyte-ab0f1598-6f65-46c2-aa92-f68203fd0a19" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:27:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1e5feab9-bc7a-462a-ad1f-893bcf3e3577 tempest-GroupSnapshotsTest-1107232334 None] Lock "cinder-quobyte-ab0f1598-6f65-46c2-aa92-f68203fd0a19" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:27:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1e5feab9-bc7a-462a-ad1f-893bcf3e3577 tempest-GroupSnapshotsTest-1107232334 None] Acquiring lock "cinder-quobyte-7b4c8378-2465-4375-96f1-fc9bba46910d" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:27:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1e5feab9-bc7a-462a-ad1f-893bcf3e3577 tempest-GroupSnapshotsTest-1107232334 None] Lock "cinder-quobyte-7b4c8378-2465-4375-96f1-fc9bba46910d" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:27:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-1e5feab9-bc7a-462a-ad1f-893bcf3e3577 tempest-GroupSnapshotsTest-1107232334 None] Deleting offline snapshot 7b4c8378-2465-4375-96f1-fc9bba46910d of volume ab0f1598-6f65-46c2-aa92-f68203fd0a19 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 09:27:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-1e5feab9-bc7a-462a-ad1f-893bcf3e3577 tempest-GroupSnapshotsTest-1107232334 None] snapshot_file for this snap is: volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19.7b4c8378-2465-4375-96f1-fc9bba46910d {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 09:27:21 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed4ab56-032f-4254-b6a6-e4ff8a310ebe]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:27:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1e5feab9-bc7a-462a-ad1f-893bcf3e3577 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19.7b4c8378-2465-4375-96f1-fc9bba46910d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:22 devstack sudo[89004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19.7b4c8378-2465-4375-96f1-fc9bba46910d
Nov 05 09:27:22 devstack sudo[89004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:22 devstack sudo[89004]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1e5feab9-bc7a-462a-ad1f-893bcf3e3577 tempest-GroupSnapshotsTest-1107232334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19.7b4c8378-2465-4375-96f1-fc9bba46910d" returned: 0 in 0.397s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-1e5feab9-bc7a-462a-ad1f-893bcf3e3577 tempest-GroupSnapshotsTest-1107232334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:27:22 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54b4545-4647-49ff-9f3e-c9f54e8c773c]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:27:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1e5feab9-bc7a-462a-ad1f-893bcf3e3577 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:22 devstack sudo[89009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19
Nov 05 09:27:22 devstack sudo[89009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:22 devstack sudo[89009]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1e5feab9-bc7a-462a-ad1f-893bcf3e3577 tempest-GroupSnapshotsTest-1107232334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19" returned: 0 in 0.387s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1e5feab9-bc7a-462a-ad1f-893bcf3e3577 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19.7b4c8378-2465-4375-96f1-fc9bba46910d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:22 devstack sudo[89014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19.7b4c8378-2465-4375-96f1-fc9bba46910d
Nov 05 09:27:22 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:23 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1e5feab9-bc7a-462a-ad1f-893bcf3e3577 tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19.7b4c8378-2465-4375-96f1-fc9bba46910d" returned: 0 in 0.380s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1e5feab9-bc7a-462a-ad1f-893bcf3e3577 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19.7b4c8378-2465-4375-96f1-fc9bba46910d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:23 devstack sudo[89019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19.7b4c8378-2465-4375-96f1-fc9bba46910d
Nov 05 09:27:23 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:23 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1e5feab9-bc7a-462a-ad1f-893bcf3e3577 tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19.7b4c8378-2465-4375-96f1-fc9bba46910d" returned: 0 in 0.255s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:23 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1e5feab9-bc7a-462a-ad1f-893bcf3e3577 tempest-GroupSnapshotsTest-1107232334 None] Lock "cinder-quobyte-7b4c8378-2465-4375-96f1-fc9bba46910d" released by "_delete_snapshot" :: held 1.550s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:27:23 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1e5feab9-bc7a-462a-ad1f-893bcf3e3577 tempest-GroupSnapshotsTest-1107232334 None] Lock "cinder-quobyte-ab0f1598-6f65-46c2-aa92-f68203fd0a19" released by "delete_snapshot" :: held 1.587s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:27:23 devstack cinder-volume[86649]: WARNING cinder.quota [None req-1e5feab9-bc7a-462a-ad1f-893bcf3e3577 tempest-GroupSnapshotsTest-1107232334 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1068950581 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1068950581, it is now deprecated. Please use the default quota class for default quota.
Nov 05 09:27:23 devstack cinder-volume[86649]: WARNING cinder.quota [None req-1e5feab9-bc7a-462a-ad1f-893bcf3e3577 tempest-GroupSnapshotsTest-1107232334 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1068950581 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1068950581, it is now deprecated. Please use the default quota class for default quota.
Nov 05 09:27:23 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-1e5feab9-bc7a-462a-ad1f-893bcf3e3577 tempest-GroupSnapshotsTest-1107232334 None] Created reservations ['f41dabb1-7e8a-403e-a9b0-1c1550ba539e', '60f4d873-af03-4625-9df1-546bacea3f4a', '3bf85020-12e5-44f2-befc-c9d3bd9fb521', '8fbc08f3-255c-4778-8715-8ac96e7012c0'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:27:23 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-1e5feab9-bc7a-462a-ad1f-893bcf3e3577 tempest-GroupSnapshotsTest-1107232334 None] group_snapshot ca6f649d-c217-4196-9a51-736ba258acb5: deleted successfully
Nov 05 09:27:24 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9d23bfd4-3952-4782-8cd6-b696b9839b28 tempest-GroupSnapshotsTest-1107232334 None] Acquiring lock "cinder-quobyte-ab0f1598-6f65-46c2-aa92-f68203fd0a19" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:27:24 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9d23bfd4-3952-4782-8cd6-b696b9839b28 tempest-GroupSnapshotsTest-1107232334 None] Lock "cinder-quobyte-ab0f1598-6f65-46c2-aa92-f68203fd0a19" acquired by "delete_volume" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:27:24 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[545522f1-0afe-4652-b8d0-95c5c1e7ac50]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:27:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9d23bfd4-3952-4782-8cd6-b696b9839b28 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:24 devstack sudo[89022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19
Nov 05 09:27:24 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:25 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9d23bfd4-3952-4782-8cd6-b696b9839b28 tempest-GroupSnapshotsTest-1107232334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19" returned: 0 in 0.696s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9d23bfd4-3952-4782-8cd6-b696b9839b28 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:25 devstack sudo[89080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19
Nov 05 09:27:25 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:25 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9d23bfd4-3952-4782-8cd6-b696b9839b28 tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ab0f1598-6f65-46c2-aa92-f68203fd0a19" returned: 0 in 0.409s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:25 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9d23bfd4-3952-4782-8cd6-b696b9839b28 tempest-GroupSnapshotsTest-1107232334 None] Lock "cinder-quobyte-ab0f1598-6f65-46c2-aa92-f68203fd0a19" released by "delete_volume" :: held 1.237s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:27:25 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-9d23bfd4-3952-4782-8cd6-b696b9839b28 tempest-GroupSnapshotsTest-1107232334 None] Created reservations ['f3cba070-1fec-4983-aa28-d3519fdf6883'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:27:25 devstack cinder-volume[86649]: WARNING cinder.quota [None req-9d23bfd4-3952-4782-8cd6-b696b9839b28 tempest-GroupSnapshotsTest-1107232334 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1068950581 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1068950581, it is now deprecated. Please use the default quota class for default quota.
Nov 05 09:27:25 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-9d23bfd4-3952-4782-8cd6-b696b9839b28 tempest-GroupSnapshotsTest-1107232334 None] Created reservations ['1d5ce558-a42e-4eb7-ab5a-7f0cb39db224', '56f7fca5-20f9-4d14-a707-763367097257', 'f3d29317-1079-4744-880f-210ca23a345b', '07725c0d-34f5-4c55-90f7-11f26f4692d3'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:27:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9d23bfd4-3952-4782-8cd6-b696b9839b28 tempest-GroupSnapshotsTest-1107232334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:27:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9d23bfd4-3952-4782-8cd6-b696b9839b28 tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:27:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9d23bfd4-3952-4782-8cd6-b696b9839b28 tempest-GroupSnapshotsTest-1107232334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:27:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9d23bfd4-3952-4782-8cd6-b696b9839b28 tempest-GroupSnapshotsTest-1107232334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:27:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9d23bfd4-3952-4782-8cd6-b696b9839b28 tempest-GroupSnapshotsTest-1107232334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:27:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9d23bfd4-3952-4782-8cd6-b696b9839b28 tempest-GroupSnapshotsTest-1107232334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:25 devstack sudo[89095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:27:25 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:26 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9d23bfd4-3952-4782-8cd6-b696b9839b28 tempest-GroupSnapshotsTest-1107232334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.345s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:26 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-9d23bfd4-3952-4782-8cd6-b696b9839b28 tempest-GroupSnapshotsTest-1107232334 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:27:26 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-9d23bfd4-3952-4782-8cd6-b696b9839b28 tempest-GroupSnapshotsTest-1107232334 None] Delete group completed successfully.
Nov 05 09:27:35 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=19,cinder:SELECT=14,cinder:INSERT=5 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:27:35 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=15,cinder:INSERT=4,cinder:UPDATE=15 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:27:40 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:27:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] Flow 'volume_create_manager' (7ac0d893-81ee-4468-9b30-c64f7e383d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:27:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32b6a3a3-d7e1-4129-90cc-7ba02731e1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:27:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32b6a3a3-d7e1-4129-90cc-7ba02731e1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-685040323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a6438c3-9c68-4458-86e5-162fbc7d6ffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d91a06276c424b128b6aec3164f4f768',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:27:40Z,use_quota=True,user_id='c9efcb85cd4f414b94650d3037fc14be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:27:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd00a75b-2fc5-4863-97ea-0322a0237839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:27:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd00a75b-2fc5-4863-97ea-0322a0237839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:27:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21b03b9a-49da-4d9c-8f53-ee9133203846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:27:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21b03b9a-49da-4d9c-8f53-ee9133203846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a6438c3-9c68-4458-86e5-162fbc7d6ffa', 'volume_name': 'volume-6a6438c3-9c68-4458-86e5-162fbc7d6ffa', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:27:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d2b292e-70af-4bb8-8ae0-ca76852fbdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:27:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d2b292e-70af-4bb8-8ae0-ca76852fbdbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:27:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b32de5e-9980-4b97-94fd-2140c0647a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:27:40 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] Volume 6a6438c3-9c68-4458-86e5-162fbc7d6ffa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a6438c3-9c68-4458-86e5-162fbc7d6ffa', 'volume_size': 1}
Nov 05 09:27:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:27:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:27:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-685040323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a6438c3-9c68-4458-86e5-162fbc7d6ffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d91a06276c424b128b6aec3164f4f768',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:27:40Z,use_quota=True,user_id='c9efcb85cd4f414b94650d3037fc14be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:27:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] Creating volume 6a6438c3-9c68-4458-86e5-162fbc7d6ffa {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:27:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:27:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:27:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:27:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:27:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:27:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:27:40 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:27:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6a6438c3-9c68-4458-86e5-162fbc7d6ffa 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:40 devstack sudo[89152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6a6438c3-9c68-4458-86e5-162fbc7d6ffa 1073741824
Nov 05 09:27:40 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:41 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6a6438c3-9c68-4458-86e5-162fbc7d6ffa 1073741824" returned: 0 in 0.898s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6a6438c3-9c68-4458-86e5-162fbc7d6ffa {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:41 devstack sudo[89196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6a6438c3-9c68-4458-86e5-162fbc7d6ffa
Nov 05 09:27:41 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:41 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6a6438c3-9c68-4458-86e5-162fbc7d6ffa" returned: 0 in 0.304s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:27:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:27:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b32de5e-9980-4b97-94fd-2140c0647a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a6438c3-9c68-4458-86e5-162fbc7d6ffa', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:27:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ddb9299-2807-44b8-b6da-5d4d0b9188b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:27:41 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] Volume volume-6a6438c3-9c68-4458-86e5-162fbc7d6ffa (6a6438c3-9c68-4458-86e5-162fbc7d6ffa): created successfully
Nov 05 09:27:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ddb9299-2807-44b8-b6da-5d4d0b9188b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:27:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] Flow 'volume_create_manager' (7ac0d893-81ee-4468-9b30-c64f7e383d66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:27:41 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f8433aeb-3956-4263-80f0-6d19ecfaf17b tempest-TaggedAttachmentsTest-1928835208 None] Created volume successfully.
Nov 05 09:27:51 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:27:51 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:DELETE=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:27:51 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-1d3801a4-2266-4b02-9442-3b87df8748f3 tempest-GroupsV314Test-758043082 None] Group tempest-GroupsV314Test-Group-1342809236: creating
Nov 05 09:27:51 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-1d3801a4-2266-4b02-9442-3b87df8748f3 tempest-GroupsV314Test-758043082 None] Group tempest-GroupsV314Test-Group-1342809236: created successfully
Nov 05 09:27:51 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-1d3801a4-2266-4b02-9442-3b87df8748f3 tempest-GroupsV314Test-758043082 None] Create group completed successfully.
Nov 05 09:27:53 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:27:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] Flow 'volume_create_manager' (5e663b44-db17-44ec-b36b-168842a05c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:27:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61656728-cf9b-49f3-a602-e4b61bb42905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:27:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61656728-cf9b-49f3-a602-e4b61bb42905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1058651388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9608f71d-d82a-47c4-ac99-a33d0e56b451,host='devstack@QuobyteHD#QuobyteHD',id=bb5d3dfb-2482-4bd1-b875-a43f46a7cf99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22324d08cb5a4f40a3744a36a4fae928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:27:53Z,use_quota=True,user_id='b57853e89e464528a530f04fde001815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fc54bd7-e66a-492b-a438-316c62d9ceae),volume_type_id=3fc54bd7-e66a-492b-a438-316c62d9ceae)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:27:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871265db-ec0f-4bf2-935b-f2820cf29776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:27:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871265db-ec0f-4bf2-935b-f2820cf29776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:27:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8460b4be-8a5f-4abb-83f3-43497eaaf115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:27:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8460b4be-8a5f-4abb-83f3-43497eaaf115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb5d3dfb-2482-4bd1-b875-a43f46a7cf99', 'volume_name': 'volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:27:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63364a8b-59f5-4260-b9f4-410fdfa1643a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:27:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63364a8b-59f5-4260-b9f4-410fdfa1643a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:27:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62e49908-5c08-4db5-83f2-4c54f7ab3504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:27:53 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] Volume bb5d3dfb-2482-4bd1-b875-a43f46a7cf99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99', 'volume_size': 1}
Nov 05 09:27:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:27:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:27:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9608f71d-d82a-47c4-ac99-a33d0e56b451,created_at=2026-11-05T08:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1058651388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9608f71d-d82a-47c4-ac99-a33d0e56b451,host='devstack@QuobyteHD#QuobyteHD',id=bb5d3dfb-2482-4bd1-b875-a43f46a7cf99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22324d08cb5a4f40a3744a36a4fae928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:27:53Z,use_quota=True,user_id='b57853e89e464528a530f04fde001815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fc54bd7-e66a-492b-a438-316c62d9ceae),volume_type_id=3fc54bd7-e66a-492b-a438-316c62d9ceae)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:27:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] Creating volume bb5d3dfb-2482-4bd1-b875-a43f46a7cf99 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:27:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:27:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:27:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:27:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:27:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:27:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:27:53 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:27:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:53 devstack sudo[89282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99 1073741824
Nov 05 09:27:53 devstack sudo[89282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:53 devstack sudo[89282]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99 1073741824" returned: 0 in 0.600s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:53 devstack sudo[89290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99
Nov 05 09:27:53 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:54 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99" returned: 0 in 0.287s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:27:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:27:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62e49908-5c08-4db5-83f2-4c54f7ab3504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:27:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (302bd26d-9fcc-4078-8b78-a61694c73148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:27:54 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] Volume volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99 (bb5d3dfb-2482-4bd1-b875-a43f46a7cf99): created successfully
Nov 05 09:27:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (302bd26d-9fcc-4078-8b78-a61694c73148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:27:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] Flow 'volume_create_manager' (5e663b44-db17-44ec-b36b-168842a05c9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:27:54 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ea66aaa6-3cee-452e-b4c3-7ca8bdd5d45c tempest-GroupsV314Test-758043082 None] Created volume successfully.
Nov 05 09:27:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:27:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:27:55 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Cloning volume bb5d3dfb-2482-4bd1-b875-a43f46a7cf99 to volume 902c5294-c62d-4f9d-8214-615dfa69b57c
Nov 05 09:27:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Creating offline snapshot f57d6740-91b9-4a7e-a9b3-9f9048b73837 of volume bb5d3dfb-2482-4bd1-b875-a43f46a7cf99 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 09:27:55 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[c967c805-e1b2-4c9f-9297-3597bfc918ac]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:27:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:55 devstack sudo[89356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99
Nov 05 09:27:55 devstack sudo[89356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:56 devstack sudo[89356]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99" returned: 0 in 0.636s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99.f57d6740-91b9-4a7e-a9b3-9f9048b73837 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:56 devstack sudo[89392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99.f57d6740-91b9-4a7e-a9b3-9f9048b73837 1G
Nov 05 09:27:56 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:56 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99.f57d6740-91b9-4a7e-a9b3-9f9048b73837 1G" returned: 0 in 0.597s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99.f57d6740-91b9-4a7e-a9b3-9f9048b73837 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:56 devstack sudo[89400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99.f57d6740-91b9-4a7e-a9b3-9f9048b73837
Nov 05 09:27:56 devstack sudo[89400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:57 devstack sudo[89400]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99.f57d6740-91b9-4a7e-a9b3-9f9048b73837" returned: 0 in 0.303s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:57 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99.f57d6740-91b9-4a7e-a9b3-9f9048b73837 is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 09:27:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99.f57d6740-91b9-4a7e-a9b3-9f9048b73837 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:57 devstack sudo[89408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99.f57d6740-91b9-4a7e-a9b3-9f9048b73837
Nov 05 09:27:57 devstack sudo[89408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:57 devstack sudo[89408]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99.f57d6740-91b9-4a7e-a9b3-9f9048b73837" returned: 0 in 0.396s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:57 devstack sudo[89411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99.info
Nov 05 09:27:57 devstack sudo[89411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:57 devstack sudo[89411]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99.info" returned: 0 in 0.300s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:57 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 09:27:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:57 devstack sudo[89414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99.info
Nov 05 09:27:57 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:58 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99.info" returned: 0 in 0.242s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:58 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Acquiring lock "cinder-quobyte-902c5294-c62d-4f9d-8214-615dfa69b57c" by "_copy_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:27:58 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Lock "cinder-quobyte-902c5294-c62d-4f9d-8214-615dfa69b57c" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:27:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] snapshot: f57d6740-91b9-4a7e-a9b3-9f9048b73837, volume: 902c5294-c62d-4f9d-8214-615dfa69b57c,  {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 09:27:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:27:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:27:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:27:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:27:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:27:58 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[fceaa542-1770-4326-a231-e7c27483c230]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:27:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99.f57d6740-91b9-4a7e-a9b3-9f9048b73837 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:58 devstack sudo[89417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99.f57d6740-91b9-4a7e-a9b3-9f9048b73837
Nov 05 09:27:58 devstack sudo[89417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:58 devstack sudo[89417]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99.f57d6740-91b9-4a7e-a9b3-9f9048b73837" returned: 0 in 0.412s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:27:58 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b668e51-b274-4c26-9c17-fb36675ab899]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:27:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:58 devstack sudo[89424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99
Nov 05 09:27:58 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:27:58 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root
Nov 05 09:27:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99" returned: 0 in 0.403s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:27:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99 {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 09:27:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Creating direct copy from snapshot {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 09:27:59 devstack cinder-volume[86649]: DEBUG cinder.utils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Path /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-902c5294-c62d-4f9d-8214-615dfa69b57c not found in is_blk_device check {{(pid=86649) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 09:27:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-902c5294-c62d-4f9d-8214-615dfa69b57c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:27:59 devstack sudo[89429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-902c5294-c62d-4f9d-8214-615dfa69b57c
Nov 05 09:27:59 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:28:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:28:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:28:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:28:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:28:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:28:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:28:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:28:00 devstack sudo[89441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:28:00 devstack sudo[89441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:28:00 devstack sudo[89441]: pam_unix(sudo:session): session closed for user root
Nov 05 09:28:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.780s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:28:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:28:07 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4,cinder:DELETE=1,cinder:INSERT=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:28:07 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=10,cinder:UPDATE=5,cinder:INSERT=2 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:28:08 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root
Nov 05 09:28:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-902c5294-c62d-4f9d-8214-615dfa69b57c" returned: 0 in 9.382s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:28:08 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Image conversion details: src /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99, size 1024.00 MB, duration 9.38 sec, destination /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-902c5294-c62d-4f9d-8214-615dfa69b57c {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 09:28:08 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Converted 1024.00 MB image at 109.13 MB/s
Nov 05 09:28:08 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-902c5294-c62d-4f9d-8214-615dfa69b57c is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 09:28:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-902c5294-c62d-4f9d-8214-615dfa69b57c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:28:08 devstack sudo[89448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-902c5294-c62d-4f9d-8214-615dfa69b57c
Nov 05 09:28:08 devstack sudo[89448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:28:08 devstack sudo[89448]: pam_unix(sudo:session): session closed for user root
Nov 05 09:28:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-902c5294-c62d-4f9d-8214-615dfa69b57c" returned: 0 in 0.566s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:28:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Lock "cinder-quobyte-902c5294-c62d-4f9d-8214-615dfa69b57c" released by "_copy_volume_from_snapshot" :: held 10.869s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:28:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Acquiring lock "cinder-quobyte-f57d6740-91b9-4a7e-a9b3-9f9048b73837" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:28:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Lock "cinder-quobyte-f57d6740-91b9-4a7e-a9b3-9f9048b73837" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:28:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Deleting offline snapshot f57d6740-91b9-4a7e-a9b3-9f9048b73837 of volume bb5d3dfb-2482-4bd1-b875-a43f46a7cf99 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 09:28:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] snapshot_file for this snap is: volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99.f57d6740-91b9-4a7e-a9b3-9f9048b73837 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 09:28:09 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f62ad4-756e-4ec5-b131-dcac58df538e]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:28:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99.f57d6740-91b9-4a7e-a9b3-9f9048b73837 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:28:09 devstack sudo[89451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99.f57d6740-91b9-4a7e-a9b3-9f9048b73837
Nov 05 09:28:09 devstack sudo[89451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:28:09 devstack sudo[89451]: pam_unix(sudo:session): session closed for user root
Nov 05 09:28:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99.f57d6740-91b9-4a7e-a9b3-9f9048b73837" returned: 0 in 0.452s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:28:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:28:09 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5e1104-9f1a-4fb7-831c-6a6b484411dc]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:28:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:28:09 devstack sudo[89456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99
Nov 05 09:28:09 devstack sudo[89456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:28:10 devstack sudo[89456]: pam_unix(sudo:session): session closed for user root
Nov 05 09:28:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99" returned: 0 in 0.705s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:28:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99.f57d6740-91b9-4a7e-a9b3-9f9048b73837 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:28:10 devstack sudo[89462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99.f57d6740-91b9-4a7e-a9b3-9f9048b73837
Nov 05 09:28:10 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:28:10 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root
Nov 05 09:28:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99.f57d6740-91b9-4a7e-a9b3-9f9048b73837" returned: 0 in 0.370s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:28:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99.f57d6740-91b9-4a7e-a9b3-9f9048b73837 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:28:10 devstack sudo[89483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99.f57d6740-91b9-4a7e-a9b3-9f9048b73837
Nov 05 09:28:10 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:28:10 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root
Nov 05 09:28:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99.f57d6740-91b9-4a7e-a9b3-9f9048b73837" returned: 0 in 0.260s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:28:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Lock "cinder-quobyte-f57d6740-91b9-4a7e-a9b3-9f9048b73837" released by "_delete_snapshot" :: held 1.900s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:28:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.563s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:28:11 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f2a7476a-cdc2-43bf-bb4d-e58075865a8a tempest-GroupsV314Test-758043082 None] Create group from source-group-9608f71d-d82a-47c4-ac99-a33d0e56b451 completed successfully.
Nov 05 09:28:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7a227302-a2fe-40a9-83c0-e06d56ec5be3 tempest-GroupsV314Test-758043082 None] Acquiring lock "cinder-quobyte-902c5294-c62d-4f9d-8214-615dfa69b57c" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:28:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7a227302-a2fe-40a9-83c0-e06d56ec5be3 tempest-GroupsV314Test-758043082 None] Lock "cinder-quobyte-902c5294-c62d-4f9d-8214-615dfa69b57c" acquired by "delete_volume" :: waited 0.026s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:28:12 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f1cfa1-b841-4e66-afaa-95dc44fc5f0f]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:28:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7a227302-a2fe-40a9-83c0-e06d56ec5be3 tempest-GroupsV314Test-758043082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-902c5294-c62d-4f9d-8214-615dfa69b57c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:28:12 devstack sudo[89486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-902c5294-c62d-4f9d-8214-615dfa69b57c
Nov 05 09:28:12 devstack sudo[89486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:28:13 devstack sudo[89486]: pam_unix(sudo:session): session closed for user root
Nov 05 09:28:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7a227302-a2fe-40a9-83c0-e06d56ec5be3 tempest-GroupsV314Test-758043082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-902c5294-c62d-4f9d-8214-615dfa69b57c" returned: 0 in 0.369s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:28:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7a227302-a2fe-40a9-83c0-e06d56ec5be3 tempest-GroupsV314Test-758043082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-902c5294-c62d-4f9d-8214-615dfa69b57c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:28:13 devstack sudo[89491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-902c5294-c62d-4f9d-8214-615dfa69b57c
Nov 05 09:28:13 devstack sudo[89491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:28:13 devstack sudo[89491]: pam_unix(sudo:session): session closed for user root
Nov 05 09:28:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7a227302-a2fe-40a9-83c0-e06d56ec5be3 tempest-GroupsV314Test-758043082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-902c5294-c62d-4f9d-8214-615dfa69b57c" returned: 0 in 0.232s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:28:13 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7a227302-a2fe-40a9-83c0-e06d56ec5be3 tempest-GroupsV314Test-758043082 None] Lock "cinder-quobyte-902c5294-c62d-4f9d-8214-615dfa69b57c" released by "delete_volume" :: held 0.666s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:28:13 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-7a227302-a2fe-40a9-83c0-e06d56ec5be3 tempest-GroupsV314Test-758043082 None] Created reservations ['19a587e8-cc8c-4adc-a866-8662c608f242'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:28:13 devstack cinder-volume[86649]: WARNING cinder.quota [None req-7a227302-a2fe-40a9-83c0-e06d56ec5be3 tempest-GroupsV314Test-758043082 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1677800455 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1677800455, it is now deprecated. Please use the default quota class for default quota.
Nov 05 09:28:13 devstack cinder-volume[86649]: WARNING cinder.quota [None req-7a227302-a2fe-40a9-83c0-e06d56ec5be3 tempest-GroupsV314Test-758043082 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1677800455 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1677800455, it is now deprecated. Please use the default quota class for default quota.
Nov 05 09:28:13 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-7a227302-a2fe-40a9-83c0-e06d56ec5be3 tempest-GroupsV314Test-758043082 None] Created reservations ['2234770e-12bc-45f0-a494-b96eb2e357e2', 'e8f1164e-0ae8-49d2-94f7-3ef7ad5b5652', 'bcb23089-1db0-4954-95c1-d45edb30b4d5', '6742463b-41e6-40d0-aa5e-d678be709ae3'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:28:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7a227302-a2fe-40a9-83c0-e06d56ec5be3 tempest-GroupsV314Test-758043082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:28:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7a227302-a2fe-40a9-83c0-e06d56ec5be3 tempest-GroupsV314Test-758043082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:28:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7a227302-a2fe-40a9-83c0-e06d56ec5be3 tempest-GroupsV314Test-758043082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:28:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7a227302-a2fe-40a9-83c0-e06d56ec5be3 tempest-GroupsV314Test-758043082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:28:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7a227302-a2fe-40a9-83c0-e06d56ec5be3 tempest-GroupsV314Test-758043082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:28:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7a227302-a2fe-40a9-83c0-e06d56ec5be3 tempest-GroupsV314Test-758043082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:28:13 devstack sudo[89494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:28:13 devstack sudo[89494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:28:14 devstack sudo[89494]: pam_unix(sudo:session): session closed for user root
Nov 05 09:28:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7a227302-a2fe-40a9-83c0-e06d56ec5be3 tempest-GroupsV314Test-758043082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.290s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:28:14 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-7a227302-a2fe-40a9-83c0-e06d56ec5be3 tempest-GroupsV314Test-758043082 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:28:14 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-7a227302-a2fe-40a9-83c0-e06d56ec5be3 tempest-GroupsV314Test-758043082 None] Delete group completed successfully.
Nov 05 09:28:14 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d994ed07-d364-49e1-a8fd-5f8ad58c19f6 tempest-GroupsV314Test-758043082 None] Acquiring lock "cinder-quobyte-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:28:14 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d994ed07-d364-49e1-a8fd-5f8ad58c19f6 tempest-GroupsV314Test-758043082 None] Lock "cinder-quobyte-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99" acquired by "delete_volume" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:28:14 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[897ea8e3-c151-40d9-9f1b-b34939ec1421]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:28:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d994ed07-d364-49e1-a8fd-5f8ad58c19f6 tempest-GroupsV314Test-758043082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:28:14 devstack sudo[89497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99
Nov 05 09:28:14 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:28:14 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root
Nov 05 09:28:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d994ed07-d364-49e1-a8fd-5f8ad58c19f6 tempest-GroupsV314Test-758043082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99" returned: 0 in 0.374s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:28:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d994ed07-d364-49e1-a8fd-5f8ad58c19f6 tempest-GroupsV314Test-758043082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:28:14 devstack sudo[89502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99
Nov 05 09:28:14 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:28:14 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root
Nov 05 09:28:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d994ed07-d364-49e1-a8fd-5f8ad58c19f6 tempest-GroupsV314Test-758043082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99" returned: 0 in 0.265s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:28:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d994ed07-d364-49e1-a8fd-5f8ad58c19f6 tempest-GroupsV314Test-758043082 None] Lock "cinder-quobyte-bb5d3dfb-2482-4bd1-b875-a43f46a7cf99" released by "delete_volume" :: held 0.709s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:28:15 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-d994ed07-d364-49e1-a8fd-5f8ad58c19f6 tempest-GroupsV314Test-758043082 None] Created reservations ['53950e9b-6e76-4618-be50-0ad65144d706'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:28:15 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-d994ed07-d364-49e1-a8fd-5f8ad58c19f6 tempest-GroupsV314Test-758043082 None] Created reservations ['1e88d76e-21ae-4241-b18f-417d5a092d08', '2aa2cb23-5fb8-405c-b56a-f1cbcc0f85fb', 'a202cbc7-e7a8-49f9-abe6-86920b38b42c', '14c19f43-6760-4d03-9c95-5786c32b2d53'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:28:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d994ed07-d364-49e1-a8fd-5f8ad58c19f6 tempest-GroupsV314Test-758043082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:28:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d994ed07-d364-49e1-a8fd-5f8ad58c19f6 tempest-GroupsV314Test-758043082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:28:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d994ed07-d364-49e1-a8fd-5f8ad58c19f6 tempest-GroupsV314Test-758043082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:28:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d994ed07-d364-49e1-a8fd-5f8ad58c19f6 tempest-GroupsV314Test-758043082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:28:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d994ed07-d364-49e1-a8fd-5f8ad58c19f6 tempest-GroupsV314Test-758043082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:28:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d994ed07-d364-49e1-a8fd-5f8ad58c19f6 tempest-GroupsV314Test-758043082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:28:15 devstack sudo[89505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:28:15 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:28:15 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root
Nov 05 09:28:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d994ed07-d364-49e1-a8fd-5f8ad58c19f6 tempest-GroupsV314Test-758043082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.274s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:28:15 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d994ed07-d364-49e1-a8fd-5f8ad58c19f6 tempest-GroupsV314Test-758043082 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:28:15 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-d994ed07-d364-49e1-a8fd-5f8ad58c19f6 tempest-GroupsV314Test-758043082 None] Delete group completed successfully.
Nov 05 09:28:21 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:28:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] Flow 'volume_create_manager' (5cccbbfe-606c-4df4-8b27-ec6c7cce8cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:28:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (377a539d-ecf8-40a0-9708-3f430d7de915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:28:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (377a539d-ecf8-40a0-9708-3f430d7de915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2003729591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29e41609-66a9-4dc9-a718-69bee9e4c792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd920f8d0faf42be90cf658a41a75830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:28:22Z,use_quota=True,user_id='83cb39db8fa54c2985987a8e3c4aa3d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:28:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1070b89-6968-489a-acdd-fb3379d2b593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:28:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1070b89-6968-489a-acdd-fb3379d2b593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:28:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d8266f-b650-491f-96ad-38997172dd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:28:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d8266f-b650-491f-96ad-38997172dd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29e41609-66a9-4dc9-a718-69bee9e4c792', 'volume_name': 'volume-29e41609-66a9-4dc9-a718-69bee9e4c792', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:28:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9de7b69-a78a-4744-82cc-51055d4333fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:28:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9de7b69-a78a-4744-82cc-51055d4333fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:28:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e97ade3-4a84-41a9-a859-ade236d7c319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:28:21 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] Volume 29e41609-66a9-4dc9-a718-69bee9e4c792: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29e41609-66a9-4dc9-a718-69bee9e4c792', 'volume_size': 1}
Nov 05 09:28:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:28:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:28:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2003729591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29e41609-66a9-4dc9-a718-69bee9e4c792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd920f8d0faf42be90cf658a41a75830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:28:22Z,use_quota=True,user_id='83cb39db8fa54c2985987a8e3c4aa3d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:28:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] Creating volume 29e41609-66a9-4dc9-a718-69bee9e4c792 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:28:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:28:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:28:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:28:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:28:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:28:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:28:21 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:28:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-29e41609-66a9-4dc9-a718-69bee9e4c792 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:28:21 devstack sudo[89511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-29e41609-66a9-4dc9-a718-69bee9e4c792 1073741824
Nov 05 09:28:21 devstack sudo[89511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:28:22 devstack sudo[89511]: pam_unix(sudo:session): session closed for user root
Nov 05 09:28:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-29e41609-66a9-4dc9-a718-69bee9e4c792 1073741824" returned: 0 in 0.411s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:28:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-29e41609-66a9-4dc9-a718-69bee9e4c792 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:28:22 devstack sudo[89517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-29e41609-66a9-4dc9-a718-69bee9e4c792
Nov 05 09:28:22 devstack sudo[89517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:28:22 devstack sudo[89517]: pam_unix(sudo:session): session closed for user root
Nov 05 09:28:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-29e41609-66a9-4dc9-a718-69bee9e4c792" returned: 0 in 0.249s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:28:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:28:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:28:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e97ade3-4a84-41a9-a859-ade236d7c319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29e41609-66a9-4dc9-a718-69bee9e4c792', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:28:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93749537-a099-4e4b-8869-b621a7f2cacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:28:22 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] Volume volume-29e41609-66a9-4dc9-a718-69bee9e4c792 (29e41609-66a9-4dc9-a718-69bee9e4c792): created successfully
Nov 05 09:28:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93749537-a099-4e4b-8869-b621a7f2cacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:28:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] Flow 'volume_create_manager' (5cccbbfe-606c-4df4-8b27-ec6c7cce8cdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:28:22 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ba01dfb7-3526-4494-87ec-3723d4563bbc tempest-VolumesServicesTestJSON-1670554268 None] Created volume successfully.
Nov 05 09:28:23 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ddd1b627-f2d2-43c7-a18b-9ddfee4f94f2 tempest-VolumesServicesTestJSON-1670554268 None] Acquiring lock "cinder-29e41609-66a9-4dc9-a718-69bee9e4c792-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:28:23 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ddd1b627-f2d2-43c7-a18b-9ddfee4f94f2 tempest-VolumesServicesTestJSON-1670554268 None] Lock "cinder-29e41609-66a9-4dc9-a718-69bee9e4c792-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:28:23 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ddd1b627-f2d2-43c7-a18b-9ddfee4f94f2 tempest-VolumesServicesTestJSON-1670554268 None] Acquiring lock "cinder-quobyte-29e41609-66a9-4dc9-a718-69bee9e4c792" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:28:23 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ddd1b627-f2d2-43c7-a18b-9ddfee4f94f2 tempest-VolumesServicesTestJSON-1670554268 None] Lock "cinder-quobyte-29e41609-66a9-4dc9-a718-69bee9e4c792" acquired by "delete_volume" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:28:23 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6f62ab-7cef-4afe-858b-d586f1682dbd]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:28:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ddd1b627-f2d2-43c7-a18b-9ddfee4f94f2 tempest-VolumesServicesTestJSON-1670554268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-29e41609-66a9-4dc9-a718-69bee9e4c792 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:28:23 devstack sudo[89524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-29e41609-66a9-4dc9-a718-69bee9e4c792
Nov 05 09:28:23 devstack sudo[89524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:28:23 devstack sudo[89524]: pam_unix(sudo:session): session closed for user root
Nov 05 09:28:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ddd1b627-f2d2-43c7-a18b-9ddfee4f94f2 tempest-VolumesServicesTestJSON-1670554268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-29e41609-66a9-4dc9-a718-69bee9e4c792" returned: 0 in 0.390s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:28:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ddd1b627-f2d2-43c7-a18b-9ddfee4f94f2 tempest-VolumesServicesTestJSON-1670554268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-29e41609-66a9-4dc9-a718-69bee9e4c792 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:28:23 devstack sudo[89529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-29e41609-66a9-4dc9-a718-69bee9e4c792
Nov 05 09:28:23 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:28:23 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root
Nov 05 09:28:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ddd1b627-f2d2-43c7-a18b-9ddfee4f94f2 tempest-VolumesServicesTestJSON-1670554268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-29e41609-66a9-4dc9-a718-69bee9e4c792" returned: 0 in 0.270s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:28:23 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ddd1b627-f2d2-43c7-a18b-9ddfee4f94f2 tempest-VolumesServicesTestJSON-1670554268 None] Lock "cinder-quobyte-29e41609-66a9-4dc9-a718-69bee9e4c792" released by "delete_volume" :: held 0.729s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:28:23 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-ddd1b627-f2d2-43c7-a18b-9ddfee4f94f2 tempest-VolumesServicesTestJSON-1670554268 None] Created reservations ['490b5473-1997-4008-bd89-f0198ae71f81', 'bd0f1014-6ee5-4e11-9507-48e811332fb8', '7c9fef06-8977-4d94-a6d0-b12e4a48e315', 'e13ec944-0cd0-4677-b604-64c1d46d0856'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:28:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ddd1b627-f2d2-43c7-a18b-9ddfee4f94f2 tempest-VolumesServicesTestJSON-1670554268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:28:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ddd1b627-f2d2-43c7-a18b-9ddfee4f94f2 tempest-VolumesServicesTestJSON-1670554268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:28:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ddd1b627-f2d2-43c7-a18b-9ddfee4f94f2 tempest-VolumesServicesTestJSON-1670554268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:28:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ddd1b627-f2d2-43c7-a18b-9ddfee4f94f2 tempest-VolumesServicesTestJSON-1670554268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:28:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ddd1b627-f2d2-43c7-a18b-9ddfee4f94f2 tempest-VolumesServicesTestJSON-1670554268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:28:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ddd1b627-f2d2-43c7-a18b-9ddfee4f94f2 tempest-VolumesServicesTestJSON-1670554268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:28:23 devstack sudo[89532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:28:23 devstack sudo[89532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:28:24 devstack sudo[89532]: pam_unix(sudo:session): session closed for user root
Nov 05 09:28:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ddd1b627-f2d2-43c7-a18b-9ddfee4f94f2 tempest-VolumesServicesTestJSON-1670554268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.285s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:28:24 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-ddd1b627-f2d2-43c7-a18b-9ddfee4f94f2 tempest-VolumesServicesTestJSON-1670554268 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:28:24 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ddd1b627-f2d2-43c7-a18b-9ddfee4f94f2 tempest-VolumesServicesTestJSON-1670554268 None] Deleted volume successfully.
Nov 05 09:28:24 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ddd1b627-f2d2-43c7-a18b-9ddfee4f94f2 tempest-VolumesServicesTestJSON-1670554268 None] Lock "cinder-29e41609-66a9-4dc9-a718-69bee9e4c792-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:28:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-886c4593-d2d0-4363-8bed-b9d51d4d344c req-09133b0b-3b09-4336-9bed-0f8230caaaeb tempest-TaggedAttachmentsTest-1928835208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:28:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-886c4593-d2d0-4363-8bed-b9d51d4d344c req-09133b0b-3b09-4336-9bed-0f8230caaaeb tempest-TaggedAttachmentsTest-1928835208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:28:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-886c4593-d2d0-4363-8bed-b9d51d4d344c req-09133b0b-3b09-4336-9bed-0f8230caaaeb tempest-TaggedAttachmentsTest-1928835208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:28:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-886c4593-d2d0-4363-8bed-b9d51d4d344c req-09133b0b-3b09-4336-9bed-0f8230caaaeb tempest-TaggedAttachmentsTest-1928835208 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1', 'name': 'volume-6a6438c3-9c68-4458-86e5-162fbc7d6ffa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '02d75d17-3963-4ba2-a694-522a163bf7c3', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 09:28:29 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-886c4593-d2d0-4363-8bed-b9d51d4d344c req-09133b0b-3b09-4336-9bed-0f8230caaaeb tempest-TaggedAttachmentsTest-1928835208 None] attachment_update completed successfully.
Nov 05 09:28:31 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:28:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] Flow 'volume_create_manager' (b9107e20-2428-46c0-a829-b4955389e174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:28:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe82258-2640-4cc3-9481-5cb5b0bff0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:28:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe82258-2640-4cc3-9481-5cb5b0bff0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1030104909',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aaa46eb-87d0-45a3-bfb2-3e0426a792a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebdcb666628046599675179ef16a693a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:28:31Z,use_quota=True,user_id='c877656a7ad54f38938136a069fc3c22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a21666a-f8da-498b-bca4-5ee3100bc050),volume_type_id=2a21666a-f8da-498b-bca4-5ee3100bc050)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:28:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3c26ae-42fe-4c90-bc48-87a58e50a6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:28:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3c26ae-42fe-4c90-bc48-87a58e50a6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:28:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48595b3d-b96c-44b5-826f-e4871ffd4daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:28:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48595b3d-b96c-44b5-826f-e4871ffd4daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8aaa46eb-87d0-45a3-bfb2-3e0426a792a6', 'volume_name': 'volume-8aaa46eb-87d0-45a3-bfb2-3e0426a792a6', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:28:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b57882a4-2e89-4aab-b0aa-96f41922b225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:28:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b57882a4-2e89-4aab-b0aa-96f41922b225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:28:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0974785c-659e-47d9-91d8-f3e8c2e6bca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:28:31 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] Volume 8aaa46eb-87d0-45a3-bfb2-3e0426a792a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8aaa46eb-87d0-45a3-bfb2-3e0426a792a6', 'volume_size': 1}
Nov 05 09:28:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:28:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:28:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1030104909',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aaa46eb-87d0-45a3-bfb2-3e0426a792a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebdcb666628046599675179ef16a693a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:28:31Z,use_quota=True,user_id='c877656a7ad54f38938136a069fc3c22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a21666a-f8da-498b-bca4-5ee3100bc050),volume_type_id=2a21666a-f8da-498b-bca4-5ee3100bc050)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:28:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] Creating volume 8aaa46eb-87d0-45a3-bfb2-3e0426a792a6 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:28:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:28:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:28:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:28:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:28:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:28:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:28:31 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:28:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8aaa46eb-87d0-45a3-bfb2-3e0426a792a6 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:28:31 devstack sudo[90052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8aaa46eb-87d0-45a3-bfb2-3e0426a792a6 1073741824
Nov 05 09:28:31 devstack sudo[90052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:28:32 devstack sudo[90052]: pam_unix(sudo:session): session closed for user root
Nov 05 09:28:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8aaa46eb-87d0-45a3-bfb2-3e0426a792a6 1073741824" returned: 0 in 0.537s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:28:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8aaa46eb-87d0-45a3-bfb2-3e0426a792a6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:28:32 devstack sudo[90062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8aaa46eb-87d0-45a3-bfb2-3e0426a792a6
Nov 05 09:28:32 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:28:32 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root
Nov 05 09:28:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8aaa46eb-87d0-45a3-bfb2-3e0426a792a6" returned: 0 in 0.265s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:28:32 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:28:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:28:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0974785c-659e-47d9-91d8-f3e8c2e6bca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aaa46eb-87d0-45a3-bfb2-3e0426a792a6', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:28:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d21bed5-48f4-4e1f-ba2d-fd8a12661a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:28:32 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] Volume volume-8aaa46eb-87d0-45a3-bfb2-3e0426a792a6 (8aaa46eb-87d0-45a3-bfb2-3e0426a792a6): created successfully
Nov 05 09:28:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d21bed5-48f4-4e1f-ba2d-fd8a12661a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:28:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] Flow 'volume_create_manager' (b9107e20-2428-46c0-a829-b4955389e174) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:28:32 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-bc181980-4929-4294-92f2-ff13a5e060b8 tempest-VolumeTypesAccessTest-1986607027 None] Created volume successfully.
Nov 05 09:28:32 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-c80a79e9-c764-4af5-8665-71775b1206f6 req-e106d6c1-d526-4736-90d3-2174ef3d0402 tempest-TaggedAttachmentsTest-1928835208 None] Terminate volume connection completed successfully.
Nov 05 09:28:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-c80a79e9-c764-4af5-8665-71775b1206f6 req-e106d6c1-d526-4736-90d3-2174ef3d0402 tempest-TaggedAttachmentsTest-1928835208 None] Deleting attachment 02d75d17-3963-4ba2-a694-522a163bf7c3. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 09:28:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ff4b2a6b-1819-4e97-be7b-b5c8a5db699a tempest-VolumeTypesAccessTest-1986607027 None] Acquiring lock "cinder-8aaa46eb-87d0-45a3-bfb2-3e0426a792a6-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:28:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ff4b2a6b-1819-4e97-be7b-b5c8a5db699a tempest-VolumeTypesAccessTest-1986607027 None] Lock "cinder-8aaa46eb-87d0-45a3-bfb2-3e0426a792a6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:28:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ff4b2a6b-1819-4e97-be7b-b5c8a5db699a tempest-VolumeTypesAccessTest-1986607027 None] Acquiring lock "cinder-quobyte-8aaa46eb-87d0-45a3-bfb2-3e0426a792a6" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:28:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ff4b2a6b-1819-4e97-be7b-b5c8a5db699a tempest-VolumeTypesAccessTest-1986607027 None] Lock "cinder-quobyte-8aaa46eb-87d0-45a3-bfb2-3e0426a792a6" acquired by "delete_volume" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:28:33 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea17522-32ee-41dc-b111-908e1309ba9f]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:28:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff4b2a6b-1819-4e97-be7b-b5c8a5db699a tempest-VolumeTypesAccessTest-1986607027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8aaa46eb-87d0-45a3-bfb2-3e0426a792a6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:28:33 devstack sudo[90093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8aaa46eb-87d0-45a3-bfb2-3e0426a792a6
Nov 05 09:28:33 devstack sudo[90093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:28:34 devstack sudo[90093]: pam_unix(sudo:session): session closed for user root
Nov 05 09:28:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff4b2a6b-1819-4e97-be7b-b5c8a5db699a tempest-VolumeTypesAccessTest-1986607027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8aaa46eb-87d0-45a3-bfb2-3e0426a792a6" returned: 0 in 0.594s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:28:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff4b2a6b-1819-4e97-be7b-b5c8a5db699a tempest-VolumeTypesAccessTest-1986607027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8aaa46eb-87d0-45a3-bfb2-3e0426a792a6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:28:34 devstack sudo[90114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8aaa46eb-87d0-45a3-bfb2-3e0426a792a6
Nov 05 09:28:34 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:28:34 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root
Nov 05 09:28:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff4b2a6b-1819-4e97-be7b-b5c8a5db699a tempest-VolumeTypesAccessTest-1986607027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8aaa46eb-87d0-45a3-bfb2-3e0426a792a6" returned: 0 in 0.285s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:28:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ff4b2a6b-1819-4e97-be7b-b5c8a5db699a tempest-VolumeTypesAccessTest-1986607027 None] Lock "cinder-quobyte-8aaa46eb-87d0-45a3-bfb2-3e0426a792a6" released by "delete_volume" :: held 0.942s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:28:34 devstack cinder-volume[86649]: WARNING cinder.quota [None req-ff4b2a6b-1819-4e97-be7b-b5c8a5db699a tempest-VolumeTypesAccessTest-1986607027 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1711838035 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1711838035, it is now deprecated. Please use the default quota class for default quota.
Nov 05 09:28:34 devstack cinder-volume[86649]: WARNING cinder.quota [None req-ff4b2a6b-1819-4e97-be7b-b5c8a5db699a tempest-VolumeTypesAccessTest-1986607027 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1711838035 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1711838035, it is now deprecated. Please use the default quota class for default quota.
Nov 05 09:28:34 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-ff4b2a6b-1819-4e97-be7b-b5c8a5db699a tempest-VolumeTypesAccessTest-1986607027 None] Created reservations ['2e719780-ca9e-4056-a42a-4ecbd84684cd', '2d6a456b-9ffa-4a5b-8aab-f109affb2093', '53a69306-351f-4247-b9f4-0c8d96c2c5d7', '08c28f8c-306f-464b-ad42-8838692504b5'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:28:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ff4b2a6b-1819-4e97-be7b-b5c8a5db699a tempest-VolumeTypesAccessTest-1986607027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:28:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ff4b2a6b-1819-4e97-be7b-b5c8a5db699a tempest-VolumeTypesAccessTest-1986607027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:28:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ff4b2a6b-1819-4e97-be7b-b5c8a5db699a tempest-VolumeTypesAccessTest-1986607027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:28:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ff4b2a6b-1819-4e97-be7b-b5c8a5db699a tempest-VolumeTypesAccessTest-1986607027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:28:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ff4b2a6b-1819-4e97-be7b-b5c8a5db699a tempest-VolumeTypesAccessTest-1986607027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:28:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff4b2a6b-1819-4e97-be7b-b5c8a5db699a tempest-VolumeTypesAccessTest-1986607027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:28:34 devstack sudo[90118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:28:34 devstack sudo[90118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:28:35 devstack sudo[90118]: pam_unix(sudo:session): session closed for user root
Nov 05 09:28:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff4b2a6b-1819-4e97-be7b-b5c8a5db699a tempest-VolumeTypesAccessTest-1986607027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.299s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:28:35 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-ff4b2a6b-1819-4e97-be7b-b5c8a5db699a tempest-VolumeTypesAccessTest-1986607027 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:28:35 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ff4b2a6b-1819-4e97-be7b-b5c8a5db699a tempest-VolumeTypesAccessTest-1986607027 None] Deleted volume successfully.
Nov 05 09:28:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ff4b2a6b-1819-4e97-be7b-b5c8a5db699a tempest-VolumeTypesAccessTest-1986607027 None] Lock "cinder-8aaa46eb-87d0-45a3-bfb2-3e0426a792a6-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:28:44 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=49,cinder:SELECT=36,cinder:INSERT=11,cinder:DELETE=3 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:28:45 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=47,cinder:SELECT=43,cinder:INSERT=9,cinder:DELETE=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:28:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8c887cb6-ae82-47db-9bbe-7de77ead6b2c tempest-TaggedAttachmentsTest-1928835208 None] Acquiring lock "cinder-6a6438c3-9c68-4458-86e5-162fbc7d6ffa-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:28:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8c887cb6-ae82-47db-9bbe-7de77ead6b2c tempest-TaggedAttachmentsTest-1928835208 None] Lock "cinder-6a6438c3-9c68-4458-86e5-162fbc7d6ffa-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:28:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8c887cb6-ae82-47db-9bbe-7de77ead6b2c tempest-TaggedAttachmentsTest-1928835208 None] Acquiring lock "cinder-quobyte-6a6438c3-9c68-4458-86e5-162fbc7d6ffa" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:28:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8c887cb6-ae82-47db-9bbe-7de77ead6b2c tempest-TaggedAttachmentsTest-1928835208 None] Lock "cinder-quobyte-6a6438c3-9c68-4458-86e5-162fbc7d6ffa" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:28:46 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fce4c98-4589-4401-8112-dc436877ee3a]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:28:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c887cb6-ae82-47db-9bbe-7de77ead6b2c tempest-TaggedAttachmentsTest-1928835208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6a6438c3-9c68-4458-86e5-162fbc7d6ffa {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:28:46 devstack sudo[90158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6a6438c3-9c68-4458-86e5-162fbc7d6ffa
Nov 05 09:28:46 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:28:46 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root
Nov 05 09:28:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c887cb6-ae82-47db-9bbe-7de77ead6b2c tempest-TaggedAttachmentsTest-1928835208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6a6438c3-9c68-4458-86e5-162fbc7d6ffa" returned: 0 in 0.397s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:28:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c887cb6-ae82-47db-9bbe-7de77ead6b2c tempest-TaggedAttachmentsTest-1928835208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6a6438c3-9c68-4458-86e5-162fbc7d6ffa {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:28:47 devstack sudo[90163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6a6438c3-9c68-4458-86e5-162fbc7d6ffa
Nov 05 09:28:47 devstack sudo[90163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:28:47 devstack sudo[90163]: pam_unix(sudo:session): session closed for user root
Nov 05 09:28:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c887cb6-ae82-47db-9bbe-7de77ead6b2c tempest-TaggedAttachmentsTest-1928835208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6a6438c3-9c68-4458-86e5-162fbc7d6ffa" returned: 0 in 0.262s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:28:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8c887cb6-ae82-47db-9bbe-7de77ead6b2c tempest-TaggedAttachmentsTest-1928835208 None] Lock "cinder-quobyte-6a6438c3-9c68-4458-86e5-162fbc7d6ffa" released by "delete_volume" :: held 0.717s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:28:47 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-8c887cb6-ae82-47db-9bbe-7de77ead6b2c tempest-TaggedAttachmentsTest-1928835208 None] Created reservations ['f46255b8-bbf7-4f85-9a81-54a416cc977f', '06dba5aa-49d7-45c3-b704-98820f617f8f', '9610e3c3-b329-4a83-b1f2-005a91835d43', '6700fced-f2bd-4563-9d61-7496d6f58110'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:28:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8c887cb6-ae82-47db-9bbe-7de77ead6b2c tempest-TaggedAttachmentsTest-1928835208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:28:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8c887cb6-ae82-47db-9bbe-7de77ead6b2c tempest-TaggedAttachmentsTest-1928835208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:28:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8c887cb6-ae82-47db-9bbe-7de77ead6b2c tempest-TaggedAttachmentsTest-1928835208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:28:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8c887cb6-ae82-47db-9bbe-7de77ead6b2c tempest-TaggedAttachmentsTest-1928835208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:28:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8c887cb6-ae82-47db-9bbe-7de77ead6b2c tempest-TaggedAttachmentsTest-1928835208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:28:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c887cb6-ae82-47db-9bbe-7de77ead6b2c tempest-TaggedAttachmentsTest-1928835208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:28:47 devstack sudo[90166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:28:47 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:28:47 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root
Nov 05 09:28:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c887cb6-ae82-47db-9bbe-7de77ead6b2c tempest-TaggedAttachmentsTest-1928835208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.274s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:28:47 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-8c887cb6-ae82-47db-9bbe-7de77ead6b2c tempest-TaggedAttachmentsTest-1928835208 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:28:47 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-8c887cb6-ae82-47db-9bbe-7de77ead6b2c tempest-TaggedAttachmentsTest-1928835208 None] Deleted volume successfully.
Nov 05 09:28:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8c887cb6-ae82-47db-9bbe-7de77ead6b2c tempest-TaggedAttachmentsTest-1928835208 None] Lock "cinder-6a6438c3-9c68-4458-86e5-162fbc7d6ffa-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:28:57 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=11,cinder:SELECT=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:29:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:29:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:29:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:29:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:29:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:29:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:29:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:29:00 devstack sudo[90201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:29:00 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:29:00 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root
Nov 05 09:29:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.247s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:29:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:29:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:29:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 8 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:29:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:29:06 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=6 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:29:28 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:29:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] Flow 'volume_create_manager' (18f0bb1f-482f-4d38-9739-b6d4069a6164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:29:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce2e5b3-03bf-4de4-b573-627244d9c975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce2e5b3-03bf-4de4-b573-627244d9c975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2066785766',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d57976fd-28a1-4cfb-90ca-30e004dc98a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4f1e076d1864024b631cf7ce44ed5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:29:28Z,use_quota=True,user_id='73562ed5bcfe4e358728bf2b0a59a633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c414ed5-5ee0-4a5e-84b9-253d56f81286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c414ed5-5ee0-4a5e-84b9-253d56f81286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d63d1d-e222-47b6-aec2-18a90461781d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d63d1d-e222-47b6-aec2-18a90461781d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd57976fd-28a1-4cfb-90ca-30e004dc98a9', 'volume_name': 'volume-d57976fd-28a1-4cfb-90ca-30e004dc98a9', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a5f30b-c508-44a3-aa8a-7b0059e796e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a5f30b-c508-44a3-aa8a-7b0059e796e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56d2b38f-af5a-4137-8639-da9a5fcb08be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:28 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] Volume d57976fd-28a1-4cfb-90ca-30e004dc98a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d57976fd-28a1-4cfb-90ca-30e004dc98a9', 'volume_size': 1}
Nov 05 09:29:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:29:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:29:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2066785766',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d57976fd-28a1-4cfb-90ca-30e004dc98a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4f1e076d1864024b631cf7ce44ed5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:29:28Z,use_quota=True,user_id='73562ed5bcfe4e358728bf2b0a59a633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:29:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] Creating volume d57976fd-28a1-4cfb-90ca-30e004dc98a9 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:29:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:29:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:29:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:29:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:29:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:29:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:29:28 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:29:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d57976fd-28a1-4cfb-90ca-30e004dc98a9 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:29:28 devstack sudo[90308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d57976fd-28a1-4cfb-90ca-30e004dc98a9 1073741824
Nov 05 09:29:28 devstack sudo[90308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:29:28 devstack sudo[90308]: pam_unix(sudo:session): session closed for user root
Nov 05 09:29:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d57976fd-28a1-4cfb-90ca-30e004dc98a9 1073741824" returned: 0 in 0.736s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:29:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d57976fd-28a1-4cfb-90ca-30e004dc98a9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:29:29 devstack sudo[90318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d57976fd-28a1-4cfb-90ca-30e004dc98a9
Nov 05 09:29:29 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:29:29 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root
Nov 05 09:29:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d57976fd-28a1-4cfb-90ca-30e004dc98a9" returned: 0 in 0.297s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:29:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:29:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:29:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56d2b38f-af5a-4137-8639-da9a5fcb08be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d57976fd-28a1-4cfb-90ca-30e004dc98a9', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca030d48-9d77-4c95-909d-756bf8cde7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:29 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] Volume volume-d57976fd-28a1-4cfb-90ca-30e004dc98a9 (d57976fd-28a1-4cfb-90ca-30e004dc98a9): created successfully
Nov 05 09:29:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca030d48-9d77-4c95-909d-756bf8cde7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] Flow 'volume_create_manager' (18f0bb1f-482f-4d38-9739-b6d4069a6164) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:29:29 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-8e245bb1-275f-4077-a0fa-1c1000a8d446 tempest-VolumesActionsTest-430653068 None] Created volume successfully.
Nov 05 09:29:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6cb1e2e0-bc2b-4143-9c1b-4b6617d4b23c tempest-VolumesActionsTest-430653068 None] Acquiring lock "cinder-d57976fd-28a1-4cfb-90ca-30e004dc98a9" by "attach_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:29:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6cb1e2e0-bc2b-4143-9c1b-4b6617d4b23c tempest-VolumesActionsTest-430653068 None] Lock "cinder-d57976fd-28a1-4cfb-90ca-30e004dc98a9" acquired by "attach_volume" :: waited 0.040s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:29:30 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-6cb1e2e0-bc2b-4143-9c1b-4b6617d4b23c tempest-VolumesActionsTest-430653068 None] Attaching volume d57976fd-28a1-4cfb-90ca-30e004dc98a9 to instance cb2fc492-65d6-4f51-bd42-0c3913f3c0d1 at mountpoint /dev/vdb on host None.
Nov 05 09:29:30 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-6cb1e2e0-bc2b-4143-9c1b-4b6617d4b23c tempest-VolumesActionsTest-430653068 None] Attach volume completed successfully.
Nov 05 09:29:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6cb1e2e0-bc2b-4143-9c1b-4b6617d4b23c tempest-VolumesActionsTest-430653068 None] Lock "cinder-d57976fd-28a1-4cfb-90ca-30e004dc98a9" released by "attach_volume" :: held 0.197s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:29:31 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f0b4282d-7126-4044-8431-9a555b9f0908 tempest-VolumesActionsTest-436228799 None] Terminate volume connection completed successfully.
Nov 05 09:29:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f0b4282d-7126-4044-8431-9a555b9f0908 tempest-VolumesActionsTest-436228799 None] Acquiring lock "cinder-d57976fd-28a1-4cfb-90ca-30e004dc98a9-detach_volume" by "detach_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:29:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f0b4282d-7126-4044-8431-9a555b9f0908 tempest-VolumesActionsTest-436228799 None] Lock "cinder-d57976fd-28a1-4cfb-90ca-30e004dc98a9-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:29:31 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f0b4282d-7126-4044-8431-9a555b9f0908 tempest-VolumesActionsTest-436228799 None] Detaching volume d57976fd-28a1-4cfb-90ca-30e004dc98a9 from instance cb2fc492-65d6-4f51-bd42-0c3913f3c0d1.
Nov 05 09:29:31 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f0b4282d-7126-4044-8431-9a555b9f0908 tempest-VolumesActionsTest-436228799 None] Detach volume completed successfully.
Nov 05 09:29:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f0b4282d-7126-4044-8431-9a555b9f0908 tempest-VolumesActionsTest-436228799 None] Lock "cinder-d57976fd-28a1-4cfb-90ca-30e004dc98a9-detach_volume" released by "detach_volume" :: held 0.081s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:29:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-db136226-5c9f-4278-b250-d007f2ca82bd tempest-VolumesActionsTest-430653068 None] Acquiring lock "cinder-d57976fd-28a1-4cfb-90ca-30e004dc98a9-detach_volume" by "detach_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:29:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-db136226-5c9f-4278-b250-d007f2ca82bd tempest-VolumesActionsTest-430653068 None] Lock "cinder-d57976fd-28a1-4cfb-90ca-30e004dc98a9-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:29:32 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-db136226-5c9f-4278-b250-d007f2ca82bd tempest-VolumesActionsTest-430653068 None] Volume detach called, but volume not attached.
Nov 05 09:29:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-db136226-5c9f-4278-b250-d007f2ca82bd tempest-VolumesActionsTest-430653068 None] Lock "cinder-d57976fd-28a1-4cfb-90ca-30e004dc98a9-detach_volume" released by "detach_volume" :: held 0.019s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:29:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e6f0c1c6-e459-4283-af26-8945b3fb385c tempest-VolumesActionsTest-430653068 None] Acquiring lock "cinder-d57976fd-28a1-4cfb-90ca-30e004dc98a9-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:29:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e6f0c1c6-e459-4283-af26-8945b3fb385c tempest-VolumesActionsTest-430653068 None] Lock "cinder-d57976fd-28a1-4cfb-90ca-30e004dc98a9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:29:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e6f0c1c6-e459-4283-af26-8945b3fb385c tempest-VolumesActionsTest-430653068 None] Acquiring lock "cinder-quobyte-d57976fd-28a1-4cfb-90ca-30e004dc98a9" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:29:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e6f0c1c6-e459-4283-af26-8945b3fb385c tempest-VolumesActionsTest-430653068 None] Lock "cinder-quobyte-d57976fd-28a1-4cfb-90ca-30e004dc98a9" acquired by "delete_volume" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:29:32 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[22389a47-ee9d-4f77-ad55-f3099fd53db7]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:29:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e6f0c1c6-e459-4283-af26-8945b3fb385c tempest-VolumesActionsTest-430653068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d57976fd-28a1-4cfb-90ca-30e004dc98a9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:29:32 devstack sudo[90376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d57976fd-28a1-4cfb-90ca-30e004dc98a9
Nov 05 09:29:32 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:29:33 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root
Nov 05 09:29:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e6f0c1c6-e459-4283-af26-8945b3fb385c tempest-VolumesActionsTest-430653068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d57976fd-28a1-4cfb-90ca-30e004dc98a9" returned: 0 in 0.525s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:29:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e6f0c1c6-e459-4283-af26-8945b3fb385c tempest-VolumesActionsTest-430653068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d57976fd-28a1-4cfb-90ca-30e004dc98a9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:29:33 devstack sudo[90383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d57976fd-28a1-4cfb-90ca-30e004dc98a9
Nov 05 09:29:33 devstack sudo[90383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:29:33 devstack sudo[90383]: pam_unix(sudo:session): session closed for user root
Nov 05 09:29:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e6f0c1c6-e459-4283-af26-8945b3fb385c tempest-VolumesActionsTest-430653068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d57976fd-28a1-4cfb-90ca-30e004dc98a9" returned: 0 in 0.291s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:29:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e6f0c1c6-e459-4283-af26-8945b3fb385c tempest-VolumesActionsTest-430653068 None] Lock "cinder-quobyte-d57976fd-28a1-4cfb-90ca-30e004dc98a9" released by "delete_volume" :: held 0.877s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:29:33 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-e6f0c1c6-e459-4283-af26-8945b3fb385c tempest-VolumesActionsTest-430653068 None] Created reservations ['dd424e5a-7434-4e7c-973c-b31c1e9da207', '9008413b-1539-4ccf-b3b7-2ef815c3dccf', 'e11f4e0e-91fe-4a6b-be5a-15ccc3d277c1', 'c1dbc86a-2fde-4c11-b4dd-951925564f92'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:29:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e6f0c1c6-e459-4283-af26-8945b3fb385c tempest-VolumesActionsTest-430653068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:29:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e6f0c1c6-e459-4283-af26-8945b3fb385c tempest-VolumesActionsTest-430653068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:29:33 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e6f0c1c6-e459-4283-af26-8945b3fb385c tempest-VolumesActionsTest-430653068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:29:33 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e6f0c1c6-e459-4283-af26-8945b3fb385c tempest-VolumesActionsTest-430653068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:29:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e6f0c1c6-e459-4283-af26-8945b3fb385c tempest-VolumesActionsTest-430653068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:29:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e6f0c1c6-e459-4283-af26-8945b3fb385c tempest-VolumesActionsTest-430653068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:29:33 devstack sudo[90386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:29:33 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:29:34 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root
Nov 05 09:29:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e6f0c1c6-e459-4283-af26-8945b3fb385c tempest-VolumesActionsTest-430653068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.717s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:29:34 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-e6f0c1c6-e459-4283-af26-8945b3fb385c tempest-VolumesActionsTest-430653068 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:29:34 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-e6f0c1c6-e459-4283-af26-8945b3fb385c tempest-VolumesActionsTest-430653068 None] Deleted volume successfully.
Nov 05 09:29:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e6f0c1c6-e459-4283-af26-8945b3fb385c tempest-VolumesActionsTest-430653068 None] Lock "cinder-d57976fd-28a1-4cfb-90ca-30e004dc98a9-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:29:38 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:29:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] Flow 'volume_create_manager' (8541109d-32b3-460c-bb1a-b91df28bda85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:29:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73a7d56a-caa5-4906-875c-eb2aa680bde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73a7d56a-caa5-4906-875c-eb2aa680bde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-286809455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2ec5f2f-7bbc-4efe-ad99-e94f3b9d5255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4f1e076d1864024b631cf7ce44ed5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:29:38Z,use_quota=True,user_id='73562ed5bcfe4e358728bf2b0a59a633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85c798c-91fc-462d-9551-3f74545741f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85c798c-91fc-462d-9551-3f74545741f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d2eda9b-7189-4cde-9740-b49d68ab9cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d2eda9b-7189-4cde-9740-b49d68ab9cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2ec5f2f-7bbc-4efe-ad99-e94f3b9d5255', 'volume_name': 'volume-c2ec5f2f-7bbc-4efe-ad99-e94f3b9d5255', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51a508d2-48fe-4c35-bd52-8c5020fb22cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51a508d2-48fe-4c35-bd52-8c5020fb22cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dc5aff3-2a86-4b72-8e24-500f8db8be37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:38 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] Volume c2ec5f2f-7bbc-4efe-ad99-e94f3b9d5255: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2ec5f2f-7bbc-4efe-ad99-e94f3b9d5255', 'volume_size': 1}
Nov 05 09:29:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:29:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:29:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-286809455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2ec5f2f-7bbc-4efe-ad99-e94f3b9d5255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4f1e076d1864024b631cf7ce44ed5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:29:38Z,use_quota=True,user_id='73562ed5bcfe4e358728bf2b0a59a633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:29:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] Creating volume c2ec5f2f-7bbc-4efe-ad99-e94f3b9d5255 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:29:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:29:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:29:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:29:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:29:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:29:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:29:38 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:29:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c2ec5f2f-7bbc-4efe-ad99-e94f3b9d5255 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:29:38 devstack sudo[90480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c2ec5f2f-7bbc-4efe-ad99-e94f3b9d5255 1073741824
Nov 05 09:29:38 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:29:38 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root
Nov 05 09:29:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c2ec5f2f-7bbc-4efe-ad99-e94f3b9d5255 1073741824" returned: 0 in 0.520s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:29:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c2ec5f2f-7bbc-4efe-ad99-e94f3b9d5255 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:29:38 devstack sudo[90488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c2ec5f2f-7bbc-4efe-ad99-e94f3b9d5255
Nov 05 09:29:38 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:29:39 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root
Nov 05 09:29:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c2ec5f2f-7bbc-4efe-ad99-e94f3b9d5255" returned: 0 in 0.306s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:29:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:29:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:29:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dc5aff3-2a86-4b72-8e24-500f8db8be37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2ec5f2f-7bbc-4efe-ad99-e94f3b9d5255', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (880ac74a-6fbb-49c1-840d-51baaaed1eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:39 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] Volume volume-c2ec5f2f-7bbc-4efe-ad99-e94f3b9d5255 (c2ec5f2f-7bbc-4efe-ad99-e94f3b9d5255): created successfully
Nov 05 09:29:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (880ac74a-6fbb-49c1-840d-51baaaed1eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] Flow 'volume_create_manager' (8541109d-32b3-460c-bb1a-b91df28bda85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:29:39 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c4a9a810-a426-48a8-b9b3-22ca5f3a5961 tempest-VolumesActionsTest-430653068 None] Created volume successfully.
Nov 05 09:29:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dc068d06-066f-41e5-8a62-84db7deaf4b7 tempest-VolumesActionsTest-436228799 None] Acquiring lock "cinder-c2ec5f2f-7bbc-4efe-ad99-e94f3b9d5255-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:29:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dc068d06-066f-41e5-8a62-84db7deaf4b7 tempest-VolumesActionsTest-436228799 None] Lock "cinder-c2ec5f2f-7bbc-4efe-ad99-e94f3b9d5255-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:29:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dc068d06-066f-41e5-8a62-84db7deaf4b7 tempest-VolumesActionsTest-436228799 None] Acquiring lock "cinder-quobyte-c2ec5f2f-7bbc-4efe-ad99-e94f3b9d5255" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:29:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dc068d06-066f-41e5-8a62-84db7deaf4b7 tempest-VolumesActionsTest-436228799 None] Lock "cinder-quobyte-c2ec5f2f-7bbc-4efe-ad99-e94f3b9d5255" acquired by "delete_volume" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:29:40 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bce3f08-6893-4e7d-8aca-9d3c286ab584]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:29:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dc068d06-066f-41e5-8a62-84db7deaf4b7 tempest-VolumesActionsTest-436228799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c2ec5f2f-7bbc-4efe-ad99-e94f3b9d5255 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:29:40 devstack sudo[90499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c2ec5f2f-7bbc-4efe-ad99-e94f3b9d5255
Nov 05 09:29:40 devstack sudo[90499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:29:40 devstack sudo[90499]: pam_unix(sudo:session): session closed for user root
Nov 05 09:29:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dc068d06-066f-41e5-8a62-84db7deaf4b7 tempest-VolumesActionsTest-436228799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c2ec5f2f-7bbc-4efe-ad99-e94f3b9d5255" returned: 0 in 0.433s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:29:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dc068d06-066f-41e5-8a62-84db7deaf4b7 tempest-VolumesActionsTest-436228799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c2ec5f2f-7bbc-4efe-ad99-e94f3b9d5255 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:29:40 devstack sudo[90505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c2ec5f2f-7bbc-4efe-ad99-e94f3b9d5255
Nov 05 09:29:40 devstack sudo[90505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:29:41 devstack sudo[90505]: pam_unix(sudo:session): session closed for user root
Nov 05 09:29:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dc068d06-066f-41e5-8a62-84db7deaf4b7 tempest-VolumesActionsTest-436228799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c2ec5f2f-7bbc-4efe-ad99-e94f3b9d5255" returned: 0 in 0.302s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:29:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dc068d06-066f-41e5-8a62-84db7deaf4b7 tempest-VolumesActionsTest-436228799 None] Lock "cinder-quobyte-c2ec5f2f-7bbc-4efe-ad99-e94f3b9d5255" released by "delete_volume" :: held 0.792s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:29:41 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-dc068d06-066f-41e5-8a62-84db7deaf4b7 tempest-VolumesActionsTest-436228799 None] Created reservations ['564c856c-7b29-4303-843c-8eeed2b31a9c', '76cea806-27ac-4eff-8322-e25d37aee6de', '0f637b18-25de-4a3f-b793-be41f374d02c', '4be1da6e-d328-4d13-9538-647eaa02d23b'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:29:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dc068d06-066f-41e5-8a62-84db7deaf4b7 tempest-VolumesActionsTest-436228799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:29:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dc068d06-066f-41e5-8a62-84db7deaf4b7 tempest-VolumesActionsTest-436228799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:29:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dc068d06-066f-41e5-8a62-84db7deaf4b7 tempest-VolumesActionsTest-436228799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:29:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dc068d06-066f-41e5-8a62-84db7deaf4b7 tempest-VolumesActionsTest-436228799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:29:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dc068d06-066f-41e5-8a62-84db7deaf4b7 tempest-VolumesActionsTest-436228799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:29:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dc068d06-066f-41e5-8a62-84db7deaf4b7 tempest-VolumesActionsTest-436228799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:29:41 devstack sudo[90508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:29:41 devstack sudo[90508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:29:41 devstack sudo[90508]: pam_unix(sudo:session): session closed for user root
Nov 05 09:29:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dc068d06-066f-41e5-8a62-84db7deaf4b7 tempest-VolumesActionsTest-436228799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.258s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:29:41 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-dc068d06-066f-41e5-8a62-84db7deaf4b7 tempest-VolumesActionsTest-436228799 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:29:41 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-dc068d06-066f-41e5-8a62-84db7deaf4b7 tempest-VolumesActionsTest-436228799 None] Deleted volume successfully.
Nov 05 09:29:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dc068d06-066f-41e5-8a62-84db7deaf4b7 tempest-VolumesActionsTest-436228799 None] Lock "cinder-c2ec5f2f-7bbc-4efe-ad99-e94f3b9d5255-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:29:42 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:29:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] Flow 'volume_create_manager' (eeee0d44-efed-46b8-b6c9-c109189f6782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:29:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92668012-3ec3-4a1e-bf5b-f4d94de75023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92668012-3ec3-4a1e-bf5b-f4d94de75023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1857664427',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fe27ff6-b283-4b81-8d3d-152454b0b54e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4f1e076d1864024b631cf7ce44ed5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:29:42Z,use_quota=True,user_id='73562ed5bcfe4e358728bf2b0a59a633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a8fdab-3dfb-4db2-af24-c50adb4feacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a8fdab-3dfb-4db2-af24-c50adb4feacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d01b1b-276e-48fd-9e72-f7e0b4a80877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d01b1b-276e-48fd-9e72-f7e0b4a80877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fe27ff6-b283-4b81-8d3d-152454b0b54e', 'volume_name': 'volume-2fe27ff6-b283-4b81-8d3d-152454b0b54e', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16cdfbcf-747a-4dcb-ad2e-3a93ae846568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16cdfbcf-747a-4dcb-ad2e-3a93ae846568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b2e2ad-87dd-441b-a011-8315b8892480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:42 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] Volume 2fe27ff6-b283-4b81-8d3d-152454b0b54e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fe27ff6-b283-4b81-8d3d-152454b0b54e', 'volume_size': 1}
Nov 05 09:29:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:29:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:29:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1857664427',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fe27ff6-b283-4b81-8d3d-152454b0b54e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4f1e076d1864024b631cf7ce44ed5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:29:42Z,use_quota=True,user_id='73562ed5bcfe4e358728bf2b0a59a633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:29:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] Creating volume 2fe27ff6-b283-4b81-8d3d-152454b0b54e {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:29:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:29:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:29:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:29:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:29:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:29:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:29:42 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:29:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2fe27ff6-b283-4b81-8d3d-152454b0b54e 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:29:42 devstack sudo[90511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2fe27ff6-b283-4b81-8d3d-152454b0b54e 1073741824
Nov 05 09:29:42 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:29:42 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root
Nov 05 09:29:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2fe27ff6-b283-4b81-8d3d-152454b0b54e 1073741824" returned: 0 in 0.535s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:29:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2fe27ff6-b283-4b81-8d3d-152454b0b54e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:29:42 devstack sudo[90516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2fe27ff6-b283-4b81-8d3d-152454b0b54e
Nov 05 09:29:42 devstack sudo[90516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:29:43 devstack sudo[90516]: pam_unix(sudo:session): session closed for user root
Nov 05 09:29:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2fe27ff6-b283-4b81-8d3d-152454b0b54e" returned: 0 in 0.260s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:29:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:29:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:29:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b2e2ad-87dd-441b-a011-8315b8892480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fe27ff6-b283-4b81-8d3d-152454b0b54e', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54d8abfb-62d1-4883-99f8-04112621a34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:43 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] Volume volume-2fe27ff6-b283-4b81-8d3d-152454b0b54e (2fe27ff6-b283-4b81-8d3d-152454b0b54e): created successfully
Nov 05 09:29:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54d8abfb-62d1-4883-99f8-04112621a34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] Flow 'volume_create_manager' (eeee0d44-efed-46b8-b6c9-c109189f6782) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:29:43 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-2546209f-ff70-401b-a58b-9bbe82afa487 tempest-VolumesActionsTest-430653068 None] Created volume successfully.
Nov 05 09:29:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bbd119f8-be46-4841-b7bd-f795f8872d42 tempest-VolumesActionsTest-436228799 None] Acquiring lock "cinder-2fe27ff6-b283-4b81-8d3d-152454b0b54e-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:29:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bbd119f8-be46-4841-b7bd-f795f8872d42 tempest-VolumesActionsTest-436228799 None] Lock "cinder-2fe27ff6-b283-4b81-8d3d-152454b0b54e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:29:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bbd119f8-be46-4841-b7bd-f795f8872d42 tempest-VolumesActionsTest-436228799 None] Acquiring lock "cinder-quobyte-2fe27ff6-b283-4b81-8d3d-152454b0b54e" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:29:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bbd119f8-be46-4841-b7bd-f795f8872d42 tempest-VolumesActionsTest-436228799 None] Lock "cinder-quobyte-2fe27ff6-b283-4b81-8d3d-152454b0b54e" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:29:44 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[325d778f-35c2-4032-8269-859b51fd2a87]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:29:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bbd119f8-be46-4841-b7bd-f795f8872d42 tempest-VolumesActionsTest-436228799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2fe27ff6-b283-4b81-8d3d-152454b0b54e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:29:44 devstack sudo[90519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2fe27ff6-b283-4b81-8d3d-152454b0b54e
Nov 05 09:29:44 devstack sudo[90519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:29:44 devstack sudo[90519]: pam_unix(sudo:session): session closed for user root
Nov 05 09:29:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bbd119f8-be46-4841-b7bd-f795f8872d42 tempest-VolumesActionsTest-436228799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2fe27ff6-b283-4b81-8d3d-152454b0b54e" returned: 0 in 0.406s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:29:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bbd119f8-be46-4841-b7bd-f795f8872d42 tempest-VolumesActionsTest-436228799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2fe27ff6-b283-4b81-8d3d-152454b0b54e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:29:44 devstack sudo[90524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2fe27ff6-b283-4b81-8d3d-152454b0b54e
Nov 05 09:29:44 devstack sudo[90524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:29:45 devstack sudo[90524]: pam_unix(sudo:session): session closed for user root
Nov 05 09:29:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bbd119f8-be46-4841-b7bd-f795f8872d42 tempest-VolumesActionsTest-436228799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2fe27ff6-b283-4b81-8d3d-152454b0b54e" returned: 0 in 0.314s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:29:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bbd119f8-be46-4841-b7bd-f795f8872d42 tempest-VolumesActionsTest-436228799 None] Lock "cinder-quobyte-2fe27ff6-b283-4b81-8d3d-152454b0b54e" released by "delete_volume" :: held 0.768s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:29:45 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-bbd119f8-be46-4841-b7bd-f795f8872d42 tempest-VolumesActionsTest-436228799 None] Created reservations ['870015a4-e02a-498a-90f4-3e3d0187d9d2', '5966d151-ebf7-4ba5-8b54-ece3ed79eca8', '6e9e1578-8551-48bb-a93b-7f80f7edd8c5', '48cd2fe9-c8bc-474a-a901-77702e5d12ed'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:29:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bbd119f8-be46-4841-b7bd-f795f8872d42 tempest-VolumesActionsTest-436228799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:29:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bbd119f8-be46-4841-b7bd-f795f8872d42 tempest-VolumesActionsTest-436228799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:29:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-bbd119f8-be46-4841-b7bd-f795f8872d42 tempest-VolumesActionsTest-436228799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:29:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-bbd119f8-be46-4841-b7bd-f795f8872d42 tempest-VolumesActionsTest-436228799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:29:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bbd119f8-be46-4841-b7bd-f795f8872d42 tempest-VolumesActionsTest-436228799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:29:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bbd119f8-be46-4841-b7bd-f795f8872d42 tempest-VolumesActionsTest-436228799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:29:45 devstack sudo[90527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:29:45 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:29:45 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root
Nov 05 09:29:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bbd119f8-be46-4841-b7bd-f795f8872d42 tempest-VolumesActionsTest-436228799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.272s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:29:45 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-bbd119f8-be46-4841-b7bd-f795f8872d42 tempest-VolumesActionsTest-436228799 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:29:45 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-bbd119f8-be46-4841-b7bd-f795f8872d42 tempest-VolumesActionsTest-436228799 None] Deleted volume successfully.
Nov 05 09:29:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bbd119f8-be46-4841-b7bd-f795f8872d42 tempest-VolumesActionsTest-436228799 None] Lock "cinder-2fe27ff6-b283-4b81-8d3d-152454b0b54e-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:29:46 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:29:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] Flow 'volume_create_manager' (85946bbe-7f01-412e-b52b-0d78c3a2db69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:29:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (274a7877-fec9-4948-88b9-b2d50360803a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (274a7877-fec9-4948-88b9-b2d50360803a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-828787620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd561b2-3451-4934-aa55-57da5664d59f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4f1e076d1864024b631cf7ce44ed5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:29:46Z,use_quota=True,user_id='73562ed5bcfe4e358728bf2b0a59a633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (169e29d4-18f2-4e77-b0e7-aca15f218b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (169e29d4-18f2-4e77-b0e7-aca15f218b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c60f923b-363c-4680-9cb1-c5a8404099ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c60f923b-363c-4680-9cb1-c5a8404099ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cd561b2-3451-4934-aa55-57da5664d59f', 'volume_name': 'volume-2cd561b2-3451-4934-aa55-57da5664d59f', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f8be697-ce26-44f9-b891-c312ce6e3fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f8be697-ce26-44f9-b891-c312ce6e3fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a01a1f3-b918-4878-bece-e1cbbda327f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:46 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] Volume 2cd561b2-3451-4934-aa55-57da5664d59f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cd561b2-3451-4934-aa55-57da5664d59f', 'volume_size': 1}
Nov 05 09:29:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:29:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:29:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-828787620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd561b2-3451-4934-aa55-57da5664d59f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4f1e076d1864024b631cf7ce44ed5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:29:46Z,use_quota=True,user_id='73562ed5bcfe4e358728bf2b0a59a633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:29:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] Creating volume 2cd561b2-3451-4934-aa55-57da5664d59f {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:29:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:29:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:29:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:29:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:29:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:29:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:29:46 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:29:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2cd561b2-3451-4934-aa55-57da5664d59f 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:29:46 devstack sudo[90530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2cd561b2-3451-4934-aa55-57da5664d59f 1073741824
Nov 05 09:29:46 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:29:46 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root
Nov 05 09:29:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2cd561b2-3451-4934-aa55-57da5664d59f 1073741824" returned: 0 in 0.435s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:29:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2cd561b2-3451-4934-aa55-57da5664d59f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:29:46 devstack sudo[90535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2cd561b2-3451-4934-aa55-57da5664d59f
Nov 05 09:29:46 devstack sudo[90535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:29:46 devstack sudo[90535]: pam_unix(sudo:session): session closed for user root
Nov 05 09:29:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2cd561b2-3451-4934-aa55-57da5664d59f" returned: 0 in 0.249s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:29:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:29:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:29:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a01a1f3-b918-4878-bece-e1cbbda327f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cd561b2-3451-4934-aa55-57da5664d59f', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69fd0fa2-37ba-44a0-8171-d4faa175da4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:47 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] Volume volume-2cd561b2-3451-4934-aa55-57da5664d59f (2cd561b2-3451-4934-aa55-57da5664d59f): created successfully
Nov 05 09:29:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69fd0fa2-37ba-44a0-8171-d4faa175da4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] Flow 'volume_create_manager' (85946bbe-7f01-412e-b52b-0d78c3a2db69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:29:47 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-e15f1f2d-f436-439a-98ff-2370ee04c800 tempest-VolumesActionsTest-430653068 None] Created volume successfully.
Nov 05 09:29:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9381d554-8473-4271-bba3-dd32e9f129b7 tempest-VolumesActionsTest-436228799 None] Acquiring lock "cinder-2cd561b2-3451-4934-aa55-57da5664d59f-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:29:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9381d554-8473-4271-bba3-dd32e9f129b7 tempest-VolumesActionsTest-436228799 None] Lock "cinder-2cd561b2-3451-4934-aa55-57da5664d59f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:29:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9381d554-8473-4271-bba3-dd32e9f129b7 tempest-VolumesActionsTest-436228799 None] Acquiring lock "cinder-quobyte-2cd561b2-3451-4934-aa55-57da5664d59f" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:29:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9381d554-8473-4271-bba3-dd32e9f129b7 tempest-VolumesActionsTest-436228799 None] Lock "cinder-quobyte-2cd561b2-3451-4934-aa55-57da5664d59f" acquired by "delete_volume" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:29:47 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d88a2b-629c-451e-89a4-8f0a326b629b]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:29:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9381d554-8473-4271-bba3-dd32e9f129b7 tempest-VolumesActionsTest-436228799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2cd561b2-3451-4934-aa55-57da5664d59f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:29:47 devstack sudo[90538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2cd561b2-3451-4934-aa55-57da5664d59f
Nov 05 09:29:47 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:29:47 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root
Nov 05 09:29:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9381d554-8473-4271-bba3-dd32e9f129b7 tempest-VolumesActionsTest-436228799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2cd561b2-3451-4934-aa55-57da5664d59f" returned: 0 in 0.372s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:29:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9381d554-8473-4271-bba3-dd32e9f129b7 tempest-VolumesActionsTest-436228799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2cd561b2-3451-4934-aa55-57da5664d59f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:29:47 devstack sudo[90543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2cd561b2-3451-4934-aa55-57da5664d59f
Nov 05 09:29:47 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:29:48 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root
Nov 05 09:29:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9381d554-8473-4271-bba3-dd32e9f129b7 tempest-VolumesActionsTest-436228799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2cd561b2-3451-4934-aa55-57da5664d59f" returned: 0 in 0.251s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:29:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9381d554-8473-4271-bba3-dd32e9f129b7 tempest-VolumesActionsTest-436228799 None] Lock "cinder-quobyte-2cd561b2-3451-4934-aa55-57da5664d59f" released by "delete_volume" :: held 0.676s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:29:48 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-9381d554-8473-4271-bba3-dd32e9f129b7 tempest-VolumesActionsTest-436228799 None] Created reservations ['61b18b22-b931-402d-9ae9-1d3c92f4ee57', 'e93a2b80-7f00-4bae-9831-9ece9b81d53e', '5728dffb-73ab-4933-86a5-f05e6aee2056', '2fb8ac6c-12a3-4153-bf33-6dbee19c853f'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:29:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9381d554-8473-4271-bba3-dd32e9f129b7 tempest-VolumesActionsTest-436228799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:29:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9381d554-8473-4271-bba3-dd32e9f129b7 tempest-VolumesActionsTest-436228799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:29:48 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9381d554-8473-4271-bba3-dd32e9f129b7 tempest-VolumesActionsTest-436228799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:29:48 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9381d554-8473-4271-bba3-dd32e9f129b7 tempest-VolumesActionsTest-436228799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:29:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9381d554-8473-4271-bba3-dd32e9f129b7 tempest-VolumesActionsTest-436228799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:29:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9381d554-8473-4271-bba3-dd32e9f129b7 tempest-VolumesActionsTest-436228799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:29:48 devstack sudo[90546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:29:48 devstack sudo[90546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:29:48 devstack sudo[90546]: pam_unix(sudo:session): session closed for user root
Nov 05 09:29:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9381d554-8473-4271-bba3-dd32e9f129b7 tempest-VolumesActionsTest-436228799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.240s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:29:48 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-9381d554-8473-4271-bba3-dd32e9f129b7 tempest-VolumesActionsTest-436228799 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:29:48 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-9381d554-8473-4271-bba3-dd32e9f129b7 tempest-VolumesActionsTest-436228799 None] Deleted volume successfully.
Nov 05 09:29:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9381d554-8473-4271-bba3-dd32e9f129b7 tempest-VolumesActionsTest-436228799 None] Lock "cinder-2cd561b2-3451-4934-aa55-57da5664d59f-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:29:49 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:29:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] Flow 'volume_create_manager' (9cd20df3-64a6-440b-818c-9c542edcae65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:29:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bd449f3-d10f-4192-881d-26629454a59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bd449f3-d10f-4192-881d-26629454a59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-99785711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea12c41a-332d-4c12-a937-ea760efcb38e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4f1e076d1864024b631cf7ce44ed5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:29:49Z,use_quota=True,user_id='73562ed5bcfe4e358728bf2b0a59a633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b8d0e6d-5d9c-4e8f-be01-98fdf8a6b8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b8d0e6d-5d9c-4e8f-be01-98fdf8a6b8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1090a244-a69a-4c85-ac92-83b89ea145a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1090a244-a69a-4c85-ac92-83b89ea145a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea12c41a-332d-4c12-a937-ea760efcb38e', 'volume_name': 'volume-ea12c41a-332d-4c12-a937-ea760efcb38e', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c62348d-a0de-4960-b20c-51b299a9e118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c62348d-a0de-4960-b20c-51b299a9e118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e273c64d-a02c-4c66-9bcf-783d9ab97ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:49 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] Volume ea12c41a-332d-4c12-a937-ea760efcb38e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea12c41a-332d-4c12-a937-ea760efcb38e', 'volume_size': 1}
Nov 05 09:29:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:29:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:29:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-99785711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea12c41a-332d-4c12-a937-ea760efcb38e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4f1e076d1864024b631cf7ce44ed5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:29:49Z,use_quota=True,user_id='73562ed5bcfe4e358728bf2b0a59a633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:29:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] Creating volume ea12c41a-332d-4c12-a937-ea760efcb38e {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:29:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:29:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:29:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:29:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:29:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:29:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:29:49 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:29:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ea12c41a-332d-4c12-a937-ea760efcb38e 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:29:49 devstack sudo[90564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ea12c41a-332d-4c12-a937-ea760efcb38e 1073741824
Nov 05 09:29:49 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:29:49 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root
Nov 05 09:29:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ea12c41a-332d-4c12-a937-ea760efcb38e 1073741824" returned: 0 in 0.428s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:29:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ea12c41a-332d-4c12-a937-ea760efcb38e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:29:49 devstack sudo[90569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ea12c41a-332d-4c12-a937-ea760efcb38e
Nov 05 09:29:49 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:29:49 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root
Nov 05 09:29:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ea12c41a-332d-4c12-a937-ea760efcb38e" returned: 0 in 0.250s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:29:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:29:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:29:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e273c64d-a02c-4c66-9bcf-783d9ab97ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea12c41a-332d-4c12-a937-ea760efcb38e', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b5c3671-3d68-4586-916f-1d9dc56a7076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:49 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] Volume volume-ea12c41a-332d-4c12-a937-ea760efcb38e (ea12c41a-332d-4c12-a937-ea760efcb38e): created successfully
Nov 05 09:29:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b5c3671-3d68-4586-916f-1d9dc56a7076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] Flow 'volume_create_manager' (9cd20df3-64a6-440b-818c-9c542edcae65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:29:50 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f0114beb-f4bf-4b4b-849a-c70ffad0baff tempest-VolumesActionsTest-430653068 None] Created volume successfully.
Nov 05 09:29:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-659d6ce9-6565-40ce-89ad-30bd6352496a tempest-VolumesActionsTest-436228799 None] Acquiring lock "cinder-ea12c41a-332d-4c12-a937-ea760efcb38e-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:29:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-659d6ce9-6565-40ce-89ad-30bd6352496a tempest-VolumesActionsTest-436228799 None] Lock "cinder-ea12c41a-332d-4c12-a937-ea760efcb38e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:29:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-659d6ce9-6565-40ce-89ad-30bd6352496a tempest-VolumesActionsTest-436228799 None] Acquiring lock "cinder-quobyte-ea12c41a-332d-4c12-a937-ea760efcb38e" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:29:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-659d6ce9-6565-40ce-89ad-30bd6352496a tempest-VolumesActionsTest-436228799 None] Lock "cinder-quobyte-ea12c41a-332d-4c12-a937-ea760efcb38e" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:29:50 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b73ede-0d6a-4394-9ed1-e07f15c2481c]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:29:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-659d6ce9-6565-40ce-89ad-30bd6352496a tempest-VolumesActionsTest-436228799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ea12c41a-332d-4c12-a937-ea760efcb38e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:29:50 devstack sudo[90572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ea12c41a-332d-4c12-a937-ea760efcb38e
Nov 05 09:29:50 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:29:50 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root
Nov 05 09:29:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-659d6ce9-6565-40ce-89ad-30bd6352496a tempest-VolumesActionsTest-436228799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ea12c41a-332d-4c12-a937-ea760efcb38e" returned: 0 in 0.357s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:29:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-659d6ce9-6565-40ce-89ad-30bd6352496a tempest-VolumesActionsTest-436228799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ea12c41a-332d-4c12-a937-ea760efcb38e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:29:50 devstack sudo[90577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ea12c41a-332d-4c12-a937-ea760efcb38e
Nov 05 09:29:50 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:29:51 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root
Nov 05 09:29:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-659d6ce9-6565-40ce-89ad-30bd6352496a tempest-VolumesActionsTest-436228799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ea12c41a-332d-4c12-a937-ea760efcb38e" returned: 0 in 0.236s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:29:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-659d6ce9-6565-40ce-89ad-30bd6352496a tempest-VolumesActionsTest-436228799 None] Lock "cinder-quobyte-ea12c41a-332d-4c12-a937-ea760efcb38e" released by "delete_volume" :: held 0.639s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:29:51 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-659d6ce9-6565-40ce-89ad-30bd6352496a tempest-VolumesActionsTest-436228799 None] Created reservations ['46ec6f4d-5231-472a-9abf-7e9384f60095', 'f26e315f-967a-4ed1-a4ac-d8832d871995', '47114823-ac9d-4bc5-89ae-ed622802974f', '3330ddf7-efdc-46b6-be43-4101ed8516ca'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:29:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-659d6ce9-6565-40ce-89ad-30bd6352496a tempest-VolumesActionsTest-436228799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:29:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-659d6ce9-6565-40ce-89ad-30bd6352496a tempest-VolumesActionsTest-436228799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:29:51 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-659d6ce9-6565-40ce-89ad-30bd6352496a tempest-VolumesActionsTest-436228799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:29:51 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-659d6ce9-6565-40ce-89ad-30bd6352496a tempest-VolumesActionsTest-436228799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:29:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-659d6ce9-6565-40ce-89ad-30bd6352496a tempest-VolumesActionsTest-436228799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:29:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-659d6ce9-6565-40ce-89ad-30bd6352496a tempest-VolumesActionsTest-436228799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:29:51 devstack sudo[90580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:29:51 devstack sudo[90580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:29:51 devstack sudo[90580]: pam_unix(sudo:session): session closed for user root
Nov 05 09:29:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-659d6ce9-6565-40ce-89ad-30bd6352496a tempest-VolumesActionsTest-436228799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.254s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:29:51 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-659d6ce9-6565-40ce-89ad-30bd6352496a tempest-VolumesActionsTest-436228799 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:29:51 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-659d6ce9-6565-40ce-89ad-30bd6352496a tempest-VolumesActionsTest-436228799 None] Deleted volume successfully.
Nov 05 09:29:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-659d6ce9-6565-40ce-89ad-30bd6352496a tempest-VolumesActionsTest-436228799 None] Lock "cinder-ea12c41a-332d-4c12-a937-ea760efcb38e-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:29:52 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:29:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] Flow 'volume_create_manager' (6701850b-a82b-4e46-9193-6e079830b0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:29:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79ea6932-c00e-4a7b-8f3b-74bbbd2a4688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79ea6932-c00e-4a7b-8f3b-74bbbd2a4688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1183264910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66ec05c4-0968-4572-9424-be359fcf845c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4f1e076d1864024b631cf7ce44ed5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:29:52Z,use_quota=True,user_id='73562ed5bcfe4e358728bf2b0a59a633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad5667af-53d3-4f9a-89e3-f24050e0e10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad5667af-53d3-4f9a-89e3-f24050e0e10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1054f31c-9b3f-46a4-81ce-7e228799c322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1054f31c-9b3f-46a4-81ce-7e228799c322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66ec05c4-0968-4572-9424-be359fcf845c', 'volume_name': 'volume-66ec05c4-0968-4572-9424-be359fcf845c', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61c136f8-86a5-4743-80b4-54e5c54c5d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61c136f8-86a5-4743-80b4-54e5c54c5d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a583f2-2e28-4d11-b17f-90500c0ef209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:52 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] Volume 66ec05c4-0968-4572-9424-be359fcf845c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66ec05c4-0968-4572-9424-be359fcf845c', 'volume_size': 1}
Nov 05 09:29:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:29:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:29:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1183264910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66ec05c4-0968-4572-9424-be359fcf845c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4f1e076d1864024b631cf7ce44ed5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:29:52Z,use_quota=True,user_id='73562ed5bcfe4e358728bf2b0a59a633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:29:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] Creating volume 66ec05c4-0968-4572-9424-be359fcf845c {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:29:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:29:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:29:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:29:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:29:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:29:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:29:52 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:29:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-66ec05c4-0968-4572-9424-be359fcf845c 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:29:52 devstack sudo[90583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-66ec05c4-0968-4572-9424-be359fcf845c 1073741824
Nov 05 09:29:52 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:29:52 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root
Nov 05 09:29:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-66ec05c4-0968-4572-9424-be359fcf845c 1073741824" returned: 0 in 0.407s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:29:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-66ec05c4-0968-4572-9424-be359fcf845c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:29:52 devstack sudo[90588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-66ec05c4-0968-4572-9424-be359fcf845c
Nov 05 09:29:52 devstack sudo[90588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:29:52 devstack sudo[90588]: pam_unix(sudo:session): session closed for user root
Nov 05 09:29:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-66ec05c4-0968-4572-9424-be359fcf845c" returned: 0 in 0.237s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:29:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:29:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:29:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a583f2-2e28-4d11-b17f-90500c0ef209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66ec05c4-0968-4572-9424-be359fcf845c', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e03129a-d65a-45fd-8903-98083d0d9278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:29:52 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] Volume volume-66ec05c4-0968-4572-9424-be359fcf845c (66ec05c4-0968-4572-9424-be359fcf845c): created successfully
Nov 05 09:29:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e03129a-d65a-45fd-8903-98083d0d9278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:29:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] Flow 'volume_create_manager' (6701850b-a82b-4e46-9193-6e079830b0ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:29:52 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-cddc19d3-a79a-42c2-a969-642d712cfce1 tempest-VolumesActionsTest-430653068 None] Created volume successfully.
Nov 05 09:29:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-abfaf919-c678-4249-949e-5e828d2da949 tempest-VolumesActionsTest-430653068 None] Acquiring lock "cinder-66ec05c4-0968-4572-9424-be359fcf845c-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:29:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-abfaf919-c678-4249-949e-5e828d2da949 tempest-VolumesActionsTest-430653068 None] Lock "cinder-66ec05c4-0968-4572-9424-be359fcf845c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:29:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-abfaf919-c678-4249-949e-5e828d2da949 tempest-VolumesActionsTest-430653068 None] Acquiring lock "cinder-quobyte-66ec05c4-0968-4572-9424-be359fcf845c" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:29:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-abfaf919-c678-4249-949e-5e828d2da949 tempest-VolumesActionsTest-430653068 None] Lock "cinder-quobyte-66ec05c4-0968-4572-9424-be359fcf845c" acquired by "delete_volume" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:29:53 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8d63a4-de6b-4d13-926f-939cf1469dec]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:29:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-abfaf919-c678-4249-949e-5e828d2da949 tempest-VolumesActionsTest-430653068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-66ec05c4-0968-4572-9424-be359fcf845c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:29:53 devstack sudo[90591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-66ec05c4-0968-4572-9424-be359fcf845c
Nov 05 09:29:53 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:29:54 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root
Nov 05 09:29:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-abfaf919-c678-4249-949e-5e828d2da949 tempest-VolumesActionsTest-430653068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-66ec05c4-0968-4572-9424-be359fcf845c" returned: 0 in 0.353s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:29:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-abfaf919-c678-4249-949e-5e828d2da949 tempest-VolumesActionsTest-430653068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-66ec05c4-0968-4572-9424-be359fcf845c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:29:54 devstack sudo[90597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-66ec05c4-0968-4572-9424-be359fcf845c
Nov 05 09:29:54 devstack sudo[90597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:29:54 devstack sudo[90597]: pam_unix(sudo:session): session closed for user root
Nov 05 09:29:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-abfaf919-c678-4249-949e-5e828d2da949 tempest-VolumesActionsTest-430653068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-66ec05c4-0968-4572-9424-be359fcf845c" returned: 0 in 0.251s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:29:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-abfaf919-c678-4249-949e-5e828d2da949 tempest-VolumesActionsTest-430653068 None] Lock "cinder-quobyte-66ec05c4-0968-4572-9424-be359fcf845c" released by "delete_volume" :: held 0.647s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:29:54 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-abfaf919-c678-4249-949e-5e828d2da949 tempest-VolumesActionsTest-430653068 None] Created reservations ['0d058c22-80ec-4391-a431-2ccaa07cc626', '61588f3f-b3d2-4801-a1f2-090e802f7e53', '1d73ae75-a546-42cf-a82d-b9bb0f863d9d', 'b8c1e577-40f4-4468-bcff-ad67c5ac6959'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:29:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-abfaf919-c678-4249-949e-5e828d2da949 tempest-VolumesActionsTest-430653068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:29:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-abfaf919-c678-4249-949e-5e828d2da949 tempest-VolumesActionsTest-430653068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:29:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-abfaf919-c678-4249-949e-5e828d2da949 tempest-VolumesActionsTest-430653068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:29:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-abfaf919-c678-4249-949e-5e828d2da949 tempest-VolumesActionsTest-430653068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:29:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-abfaf919-c678-4249-949e-5e828d2da949 tempest-VolumesActionsTest-430653068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:29:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-abfaf919-c678-4249-949e-5e828d2da949 tempest-VolumesActionsTest-430653068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:29:54 devstack sudo[90600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:29:54 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:29:54 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root
Nov 05 09:29:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-abfaf919-c678-4249-949e-5e828d2da949 tempest-VolumesActionsTest-430653068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.285s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:29:54 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-abfaf919-c678-4249-949e-5e828d2da949 tempest-VolumesActionsTest-430653068 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:29:54 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-abfaf919-c678-4249-949e-5e828d2da949 tempest-VolumesActionsTest-430653068 None] Deleted volume successfully.
Nov 05 09:29:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-abfaf919-c678-4249-949e-5e828d2da949 tempest-VolumesActionsTest-430653068 None] Lock "cinder-66ec05c4-0968-4572-9424-be359fcf845c-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:30:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:30:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:30:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:30:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:30:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:30:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:30:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:00 devstack sudo[90638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:30:00 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:00 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.339s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:30:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:30:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 8 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:30:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:30:04 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=68,cinder:SELECT=53,cinder:DELETE=5,cinder:INSERT=14 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:30:04 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=46,cinder:INSERT=18,cinder:UPDATE=71,cinder:DELETE=7 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:30:05 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:30:05 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] Flow 'volume_create_manager' (9e867c38-bd81-4425-a51b-cf284b502c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:30:05 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0314cbfb-54c5-412d-9308-d43f0fb50369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:05 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0314cbfb-54c5-412d-9308-d43f0fb50369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1025669788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60ab7b69-ae03-4977-bb12-2b5cdfc47e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07fd4d463deb4ea28b0d6471a8d43076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:30:06Z,use_quota=True,user_id='693ed10a6cab46f8bed92a922f4e691e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:30:05 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c8b6c21-c218-4117-9d63-d3df21f3c461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:05 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c8b6c21-c218-4117-9d63-d3df21f3c461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:30:05 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f403d06f-9b43-4d0b-a125-1c6adb353a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:05 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f403d06f-9b43-4d0b-a125-1c6adb353a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60ab7b69-ae03-4977-bb12-2b5cdfc47e91', 'volume_name': 'volume-60ab7b69-ae03-4977-bb12-2b5cdfc47e91', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:30:05 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (787da166-7fdc-46fe-8d6d-5f7e2cdf820f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:05 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (787da166-7fdc-46fe-8d6d-5f7e2cdf820f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:30:05 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (379b869e-c754-4cf2-8958-539339ce417b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:05 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] Volume 60ab7b69-ae03-4977-bb12-2b5cdfc47e91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60ab7b69-ae03-4977-bb12-2b5cdfc47e91', 'volume_size': 1}
Nov 05 09:30:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:30:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:30:05 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1025669788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60ab7b69-ae03-4977-bb12-2b5cdfc47e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07fd4d463deb4ea28b0d6471a8d43076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:30:06Z,use_quota=True,user_id='693ed10a6cab46f8bed92a922f4e691e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:30:05 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] Creating volume 60ab7b69-ae03-4977-bb12-2b5cdfc47e91 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:30:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:30:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:30:05 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:30:05 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:30:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:30:05 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:30:05 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:30:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-60ab7b69-ae03-4977-bb12-2b5cdfc47e91 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:05 devstack sudo[90648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-60ab7b69-ae03-4977-bb12-2b5cdfc47e91 1073741824
Nov 05 09:30:05 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:06 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-60ab7b69-ae03-4977-bb12-2b5cdfc47e91 1073741824" returned: 0 in 0.457s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-60ab7b69-ae03-4977-bb12-2b5cdfc47e91 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:06 devstack sudo[90653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-60ab7b69-ae03-4977-bb12-2b5cdfc47e91
Nov 05 09:30:06 devstack sudo[90653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:06 devstack sudo[90653]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-60ab7b69-ae03-4977-bb12-2b5cdfc47e91" returned: 0 in 0.298s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:30:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:30:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (379b869e-c754-4cf2-8958-539339ce417b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60ab7b69-ae03-4977-bb12-2b5cdfc47e91', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:30:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5dd87a-60b7-40e0-ab20-bec26554272d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:06 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] Volume volume-60ab7b69-ae03-4977-bb12-2b5cdfc47e91 (60ab7b69-ae03-4977-bb12-2b5cdfc47e91): created successfully
Nov 05 09:30:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5dd87a-60b7-40e0-ab20-bec26554272d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:30:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] Flow 'volume_create_manager' (9e867c38-bd81-4425-a51b-cf284b502c69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:30:06 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-03ebe1d8-73fd-4673-bc17-8be6cb2b7090 tempest-ServerActionsTestOtherA-1591449576 None] Created volume successfully.
Nov 05 09:30:16 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:30:16 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1,cinder:DELETE=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:30:19 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:30:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] Flow 'volume_create_manager' (98f8e1a2-64b9-42eb-a5de-e219d8bacda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:30:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (436cb173-9c26-498d-b367-068c56666dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (436cb173-9c26-498d-b367-068c56666dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-654082784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e355e4b7-f3ca-44d6-9624-ecd76c33c1b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314d413f751c4f2f907f4f4e2f778ca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:30:19Z,use_quota=True,user_id='49a5deced6b5425cbf9d8277605c4600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:30:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3dd5abc-349e-4f42-a5f4-70c994441b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3dd5abc-349e-4f42-a5f4-70c994441b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:30:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (288b6fb6-dc3d-49ac-a66f-1e238edc64e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (288b6fb6-dc3d-49ac-a66f-1e238edc64e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e355e4b7-f3ca-44d6-9624-ecd76c33c1b0', 'volume_name': 'volume-e355e4b7-f3ca-44d6-9624-ecd76c33c1b0', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:30:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9954634-66e0-4939-83b9-8511a5aeb799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9954634-66e0-4939-83b9-8511a5aeb799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:30:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faa79e37-811a-49ea-b41b-dd4b6e69ad36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:19 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] Volume e355e4b7-f3ca-44d6-9624-ecd76c33c1b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e355e4b7-f3ca-44d6-9624-ecd76c33c1b0', 'volume_size': 1}
Nov 05 09:30:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:30:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:30:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-654082784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e355e4b7-f3ca-44d6-9624-ecd76c33c1b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314d413f751c4f2f907f4f4e2f778ca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:30:19Z,use_quota=True,user_id='49a5deced6b5425cbf9d8277605c4600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:30:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] Creating volume e355e4b7-f3ca-44d6-9624-ecd76c33c1b0 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:30:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:30:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:30:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:30:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:30:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:30:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:30:19 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:30:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e355e4b7-f3ca-44d6-9624-ecd76c33c1b0 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:19 devstack sudo[90725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e355e4b7-f3ca-44d6-9624-ecd76c33c1b0 1073741824
Nov 05 09:30:19 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:19 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e355e4b7-f3ca-44d6-9624-ecd76c33c1b0 1073741824" returned: 0 in 0.570s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e355e4b7-f3ca-44d6-9624-ecd76c33c1b0 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:19 devstack sudo[90731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e355e4b7-f3ca-44d6-9624-ecd76c33c1b0
Nov 05 09:30:19 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:20 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e355e4b7-f3ca-44d6-9624-ecd76c33c1b0" returned: 0 in 0.331s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:30:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:30:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faa79e37-811a-49ea-b41b-dd4b6e69ad36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e355e4b7-f3ca-44d6-9624-ecd76c33c1b0', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:30:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b8f6a6-b465-468a-bc07-7af87e99199e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:20 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] Volume volume-e355e4b7-f3ca-44d6-9624-ecd76c33c1b0 (e355e4b7-f3ca-44d6-9624-ecd76c33c1b0): created successfully
Nov 05 09:30:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b8f6a6-b465-468a-bc07-7af87e99199e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:30:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] Flow 'volume_create_manager' (98f8e1a2-64b9-42eb-a5de-e219d8bacda1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:30:20 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-8a91b285-ee11-48d4-b252-6dab962da446 tempest-VolumesTransfersV357Test-187632169 None] Created volume successfully.
Nov 05 09:30:21 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-18b0324b-bd01-4aed-9cd0-59b565a35d63 tempest-VolumesTransfersV357Test-1114600563 None] Transfer volume completed successfully.
Nov 05 09:30:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a913d453-2bdc-4bcf-9c02-ecef3d1e145f tempest-VolumesTransfersV357Test-26226836 None] Acquiring lock "cinder-e355e4b7-f3ca-44d6-9624-ecd76c33c1b0-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:30:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a913d453-2bdc-4bcf-9c02-ecef3d1e145f tempest-VolumesTransfersV357Test-26226836 None] Lock "cinder-e355e4b7-f3ca-44d6-9624-ecd76c33c1b0-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:30:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a913d453-2bdc-4bcf-9c02-ecef3d1e145f tempest-VolumesTransfersV357Test-26226836 None] Acquiring lock "cinder-quobyte-e355e4b7-f3ca-44d6-9624-ecd76c33c1b0" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:30:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a913d453-2bdc-4bcf-9c02-ecef3d1e145f tempest-VolumesTransfersV357Test-26226836 None] Lock "cinder-quobyte-e355e4b7-f3ca-44d6-9624-ecd76c33c1b0" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:30:22 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b339a0-c84e-4248-b4b2-ada29956d017]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:30:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a913d453-2bdc-4bcf-9c02-ecef3d1e145f tempest-VolumesTransfersV357Test-26226836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e355e4b7-f3ca-44d6-9624-ecd76c33c1b0 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:22 devstack sudo[90736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e355e4b7-f3ca-44d6-9624-ecd76c33c1b0
Nov 05 09:30:22 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:23 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a913d453-2bdc-4bcf-9c02-ecef3d1e145f tempest-VolumesTransfersV357Test-26226836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e355e4b7-f3ca-44d6-9624-ecd76c33c1b0" returned: 0 in 0.390s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a913d453-2bdc-4bcf-9c02-ecef3d1e145f tempest-VolumesTransfersV357Test-26226836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e355e4b7-f3ca-44d6-9624-ecd76c33c1b0 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:23 devstack sudo[90741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e355e4b7-f3ca-44d6-9624-ecd76c33c1b0
Nov 05 09:30:23 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:23 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a913d453-2bdc-4bcf-9c02-ecef3d1e145f tempest-VolumesTransfersV357Test-26226836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e355e4b7-f3ca-44d6-9624-ecd76c33c1b0" returned: 0 in 0.262s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:23 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a913d453-2bdc-4bcf-9c02-ecef3d1e145f tempest-VolumesTransfersV357Test-26226836 None] Lock "cinder-quobyte-e355e4b7-f3ca-44d6-9624-ecd76c33c1b0" released by "delete_volume" :: held 0.719s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:30:23 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-a913d453-2bdc-4bcf-9c02-ecef3d1e145f tempest-VolumesTransfersV357Test-26226836 None] Created reservations ['d2b34889-c935-45ae-aaf3-0c1070e427b4', '63ff694d-92df-4c90-baef-8a3110e31a9a', 'a9a78ce6-1b13-4cb1-bdda-0e615cfb8307', 'd4265a3a-b734-430b-838f-f92979ec0ccc'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:30:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a913d453-2bdc-4bcf-9c02-ecef3d1e145f tempest-VolumesTransfersV357Test-26226836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:30:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a913d453-2bdc-4bcf-9c02-ecef3d1e145f tempest-VolumesTransfersV357Test-26226836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:30:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a913d453-2bdc-4bcf-9c02-ecef3d1e145f tempest-VolumesTransfersV357Test-26226836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:30:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a913d453-2bdc-4bcf-9c02-ecef3d1e145f tempest-VolumesTransfersV357Test-26226836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:30:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a913d453-2bdc-4bcf-9c02-ecef3d1e145f tempest-VolumesTransfersV357Test-26226836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:30:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a913d453-2bdc-4bcf-9c02-ecef3d1e145f tempest-VolumesTransfersV357Test-26226836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:23 devstack sudo[90744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:30:23 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:23 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a913d453-2bdc-4bcf-9c02-ecef3d1e145f tempest-VolumesTransfersV357Test-26226836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.338s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:23 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-a913d453-2bdc-4bcf-9c02-ecef3d1e145f tempest-VolumesTransfersV357Test-26226836 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:30:23 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-a913d453-2bdc-4bcf-9c02-ecef3d1e145f tempest-VolumesTransfersV357Test-26226836 None] Deleted volume successfully.
Nov 05 09:30:23 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a913d453-2bdc-4bcf-9c02-ecef3d1e145f tempest-VolumesTransfersV357Test-26226836 None] Lock "cinder-e355e4b7-f3ca-44d6-9624-ecd76c33c1b0-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:30:24 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:30:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] Flow 'volume_create_manager' (c03350f4-6991-4bae-8184-148b7fcc6362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:30:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ecb7dae-df3f-4e38-83ea-ef3031c39762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ecb7dae-df3f-4e38-83ea-ef3031c39762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1103056314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd991a5-6e2d-4040-9615-f2cf397a51f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314d413f751c4f2f907f4f4e2f778ca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:30:24Z,use_quota=True,user_id='49a5deced6b5425cbf9d8277605c4600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:30:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da5a0693-7e6e-4566-bb38-f1b57678d304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da5a0693-7e6e-4566-bb38-f1b57678d304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:30:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3e6e258-2af3-46a5-a4b2-286ea288fa37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3e6e258-2af3-46a5-a4b2-286ea288fa37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fd991a5-6e2d-4040-9615-f2cf397a51f2', 'volume_name': 'volume-0fd991a5-6e2d-4040-9615-f2cf397a51f2', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:30:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba352c70-d14e-4be7-ad77-0c5b96c0e5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba352c70-d14e-4be7-ad77-0c5b96c0e5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:30:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfeb11ed-8520-407e-801c-7979a7f1773d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:24 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] Volume 0fd991a5-6e2d-4040-9615-f2cf397a51f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fd991a5-6e2d-4040-9615-f2cf397a51f2', 'volume_size': 1}
Nov 05 09:30:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:30:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:30:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1103056314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd991a5-6e2d-4040-9615-f2cf397a51f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314d413f751c4f2f907f4f4e2f778ca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:30:24Z,use_quota=True,user_id='49a5deced6b5425cbf9d8277605c4600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:30:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] Creating volume 0fd991a5-6e2d-4040-9615-f2cf397a51f2 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:30:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:30:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:30:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:30:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:30:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:30:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:30:24 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:30:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0fd991a5-6e2d-4040-9615-f2cf397a51f2 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:24 devstack sudo[90747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0fd991a5-6e2d-4040-9615-f2cf397a51f2 1073741824
Nov 05 09:30:24 devstack sudo[90747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:25 devstack sudo[90747]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0fd991a5-6e2d-4040-9615-f2cf397a51f2 1073741824" returned: 0 in 0.451s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0fd991a5-6e2d-4040-9615-f2cf397a51f2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:25 devstack sudo[90753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0fd991a5-6e2d-4040-9615-f2cf397a51f2
Nov 05 09:30:25 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:25 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0fd991a5-6e2d-4040-9615-f2cf397a51f2" returned: 0 in 0.297s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:30:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:30:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfeb11ed-8520-407e-801c-7979a7f1773d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fd991a5-6e2d-4040-9615-f2cf397a51f2', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:30:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cda27cd2-160f-4b58-833c-2f71664ae799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:25 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] Volume volume-0fd991a5-6e2d-4040-9615-f2cf397a51f2 (0fd991a5-6e2d-4040-9615-f2cf397a51f2): created successfully
Nov 05 09:30:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cda27cd2-160f-4b58-833c-2f71664ae799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:30:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] Flow 'volume_create_manager' (c03350f4-6991-4bae-8184-148b7fcc6362) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:30:25 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-083b4b1d-2008-4e0f-9719-2b6800facb24 tempest-VolumesTransfersV357Test-187632169 None] Created volume successfully.
Nov 05 09:30:26 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ff1c9f16-5515-4bc5-b198-c4787bd92f00 tempest-VolumesTransfersV357Test-26226836 None] Acquiring lock "cinder-0fd991a5-6e2d-4040-9615-f2cf397a51f2-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:30:26 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ff1c9f16-5515-4bc5-b198-c4787bd92f00 tempest-VolumesTransfersV357Test-26226836 None] Lock "cinder-0fd991a5-6e2d-4040-9615-f2cf397a51f2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:30:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ff1c9f16-5515-4bc5-b198-c4787bd92f00 tempest-VolumesTransfersV357Test-26226836 None] Acquiring lock "cinder-quobyte-0fd991a5-6e2d-4040-9615-f2cf397a51f2" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:30:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ff1c9f16-5515-4bc5-b198-c4787bd92f00 tempest-VolumesTransfersV357Test-26226836 None] Lock "cinder-quobyte-0fd991a5-6e2d-4040-9615-f2cf397a51f2" acquired by "delete_volume" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:30:27 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[514575c8-b4c1-4b0b-abb9-522dde66fde0]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:30:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff1c9f16-5515-4bc5-b198-c4787bd92f00 tempest-VolumesTransfersV357Test-26226836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0fd991a5-6e2d-4040-9615-f2cf397a51f2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:27 devstack sudo[90756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0fd991a5-6e2d-4040-9615-f2cf397a51f2
Nov 05 09:30:27 devstack sudo[90756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:27 devstack sudo[90756]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff1c9f16-5515-4bc5-b198-c4787bd92f00 tempest-VolumesTransfersV357Test-26226836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0fd991a5-6e2d-4040-9615-f2cf397a51f2" returned: 0 in 0.361s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff1c9f16-5515-4bc5-b198-c4787bd92f00 tempest-VolumesTransfersV357Test-26226836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0fd991a5-6e2d-4040-9615-f2cf397a51f2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:27 devstack sudo[90761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0fd991a5-6e2d-4040-9615-f2cf397a51f2
Nov 05 09:30:27 devstack sudo[90761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:27 devstack sudo[90761]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff1c9f16-5515-4bc5-b198-c4787bd92f00 tempest-VolumesTransfersV357Test-26226836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0fd991a5-6e2d-4040-9615-f2cf397a51f2" returned: 0 in 0.288s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ff1c9f16-5515-4bc5-b198-c4787bd92f00 tempest-VolumesTransfersV357Test-26226836 None] Lock "cinder-quobyte-0fd991a5-6e2d-4040-9615-f2cf397a51f2" released by "delete_volume" :: held 0.712s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:30:27 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-ff1c9f16-5515-4bc5-b198-c4787bd92f00 tempest-VolumesTransfersV357Test-26226836 None] Created reservations ['2bbd59fe-27e8-4949-a5c6-379740a19b8f', 'be4e1ce7-9af5-4c92-99d0-b5d2a59d1fd8', 'e7b934f8-2d1b-4673-98cf-570fd8455ee7', '82b3643c-4055-436a-b119-293462cddfdb'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:30:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ff1c9f16-5515-4bc5-b198-c4787bd92f00 tempest-VolumesTransfersV357Test-26226836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:30:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ff1c9f16-5515-4bc5-b198-c4787bd92f00 tempest-VolumesTransfersV357Test-26226836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:30:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ff1c9f16-5515-4bc5-b198-c4787bd92f00 tempest-VolumesTransfersV357Test-26226836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:30:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ff1c9f16-5515-4bc5-b198-c4787bd92f00 tempest-VolumesTransfersV357Test-26226836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:30:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ff1c9f16-5515-4bc5-b198-c4787bd92f00 tempest-VolumesTransfersV357Test-26226836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:30:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff1c9f16-5515-4bc5-b198-c4787bd92f00 tempest-VolumesTransfersV357Test-26226836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:27 devstack sudo[90766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:30:27 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:28 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff1c9f16-5515-4bc5-b198-c4787bd92f00 tempest-VolumesTransfersV357Test-26226836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.292s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:28 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-ff1c9f16-5515-4bc5-b198-c4787bd92f00 tempest-VolumesTransfersV357Test-26226836 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:30:28 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ff1c9f16-5515-4bc5-b198-c4787bd92f00 tempest-VolumesTransfersV357Test-26226836 None] Deleted volume successfully.
Nov 05 09:30:28 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ff1c9f16-5515-4bc5-b198-c4787bd92f00 tempest-VolumesTransfersV357Test-26226836 None] Lock "cinder-0fd991a5-6e2d-4040-9615-f2cf397a51f2-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:30:34 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:30:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] Flow 'volume_create_manager' (6c6b5cdb-187e-4bb4-a353-93bafe09906f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:30:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3108bb8f-cc41-4321-85de-7b1cd1f6fd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3108bb8f-cc41-4321-85de-7b1cd1f6fd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-572041212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3190de1-bc6e-437f-b252-98505d73cdfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75c301dee4e7441b9fecdc970853eb89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:30:35Z,use_quota=True,user_id='d8a44b5095174c83827945741c153949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:30:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dc9c31f-1dc7-4b2f-8d2b-d4328c5d3510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dc9c31f-1dc7-4b2f-8d2b-d4328c5d3510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:30:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76db837e-ab28-4279-bcb2-33b43d0d0cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76db837e-ab28-4279-bcb2-33b43d0d0cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3190de1-bc6e-437f-b252-98505d73cdfe', 'volume_name': 'volume-f3190de1-bc6e-437f-b252-98505d73cdfe', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:30:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b57368af-b855-48b1-8953-1470cfb97246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b57368af-b855-48b1-8953-1470cfb97246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:30:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (232f7af6-b1d6-42b0-bcc9-7fc2abdab30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:34 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] Volume f3190de1-bc6e-437f-b252-98505d73cdfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3190de1-bc6e-437f-b252-98505d73cdfe', 'volume_size': 1}
Nov 05 09:30:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:30:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:30:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-572041212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3190de1-bc6e-437f-b252-98505d73cdfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75c301dee4e7441b9fecdc970853eb89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:30:35Z,use_quota=True,user_id='d8a44b5095174c83827945741c153949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:30:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] Creating volume f3190de1-bc6e-437f-b252-98505d73cdfe {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:30:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:30:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:30:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:30:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:30:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:30:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:30:34 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:30:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:34 devstack sudo[90827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe 1073741824
Nov 05 09:30:34 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:35 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe 1073741824" returned: 0 in 0.473s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:35 devstack sudo[90833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe
Nov 05 09:30:35 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:35 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe" returned: 0 in 0.238s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:30:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:30:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (232f7af6-b1d6-42b0-bcc9-7fc2abdab30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3190de1-bc6e-437f-b252-98505d73cdfe', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:30:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (802e4a3a-bb5d-4dbe-9e19-3d20da18a33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:35 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] Volume volume-f3190de1-bc6e-437f-b252-98505d73cdfe (f3190de1-bc6e-437f-b252-98505d73cdfe): created successfully
Nov 05 09:30:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (802e4a3a-bb5d-4dbe-9e19-3d20da18a33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:30:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] Flow 'volume_create_manager' (6c6b5cdb-187e-4bb4-a353-93bafe09906f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:30:35 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-e5a1ec78-3fa9-4506-9b78-ccbd76fde0a0 tempest-VolumesCloneTest-477093319 None] Created volume successfully.
Nov 05 09:30:36 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:30:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Flow 'volume_create_manager' (d4ad04ca-c67f-4e9d-94f7-b57bb850778e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:30:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33b04fd4-4e45-430e-bbdb-fe2112d24f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33b04fd4-4e45-430e-bbdb-fe2112d24f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1775434162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a72dd19f-3cd3-47dd-92da-bf8dc34f8b48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75c301dee4e7441b9fecdc970853eb89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:30:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=f3190de1-bc6e-437f-b252-98505d73cdfe,status='creating',terminated_at=None,updated_at=2026-11-05T08:30:36Z,use_quota=True,user_id='d8a44b5095174c83827945741c153949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:30:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fdba58c-d7af-47b9-b36c-224ab7c09cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fdba58c-d7af-47b9-b36c-224ab7c09cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:30:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c863cc3-78c0-4b5e-9d12-94a2f068f2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c863cc3-78c0-4b5e-9d12-94a2f068f2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a72dd19f-3cd3-47dd-92da-bf8dc34f8b48', 'volume_name': 'volume-a72dd19f-3cd3-47dd-92da-bf8dc34f8b48', 'volume_size': 2, 'source_volid': 'f3190de1-bc6e-437f-b252-98505d73cdfe', 'source_volstatus': 'available'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:30:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1ec7b37-2118-4508-9178-f6d7964601c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1ec7b37-2118-4508-9178-f6d7964601c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:30:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (126dc07b-f897-492b-9b58-b16e9d39ba4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:36 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Volume a72dd19f-3cd3-47dd-92da-bf8dc34f8b48: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a72dd19f-3cd3-47dd-92da-bf8dc34f8b48', 'volume_size': 2, 'source_volid': 'f3190de1-bc6e-437f-b252-98505d73cdfe', 'source_volstatus': 'available'}
Nov 05 09:30:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:30:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:30:36 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Cloning volume f3190de1-bc6e-437f-b252-98505d73cdfe to volume a72dd19f-3cd3-47dd-92da-bf8dc34f8b48
Nov 05 09:30:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Creating offline snapshot 137d34ab-04ea-419f-8569-d17a2f1beb34 of volume f3190de1-bc6e-437f-b252-98505d73cdfe {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 09:30:36 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d65176b-bb38-46b7-8e53-880c729b86b4]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:30:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:36 devstack sudo[90836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe
Nov 05 09:30:36 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:36 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe" returned: 0 in 0.399s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe.137d34ab-04ea-419f-8569-d17a2f1beb34 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:36 devstack sudo[90841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe.137d34ab-04ea-419f-8569-d17a2f1beb34 1G
Nov 05 09:30:36 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:37 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe.137d34ab-04ea-419f-8569-d17a2f1beb34 1G" returned: 0 in 0.451s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3190de1-bc6e-437f-b252-98505d73cdfe -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe.137d34ab-04ea-419f-8569-d17a2f1beb34 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:37 devstack sudo[90846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3190de1-bc6e-437f-b252-98505d73cdfe -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe.137d34ab-04ea-419f-8569-d17a2f1beb34
Nov 05 09:30:37 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:37 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3190de1-bc6e-437f-b252-98505d73cdfe -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe.137d34ab-04ea-419f-8569-d17a2f1beb34" returned: 0 in 0.275s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:37 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe.137d34ab-04ea-419f-8569-d17a2f1beb34 is being set with open permissions: ugo+rw
Nov 05 09:30:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe.137d34ab-04ea-419f-8569-d17a2f1beb34 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:37 devstack sudo[90851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe.137d34ab-04ea-419f-8569-d17a2f1beb34
Nov 05 09:30:37 devstack sudo[90851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:37 devstack sudo[90851]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe.137d34ab-04ea-419f-8569-d17a2f1beb34" returned: 0 in 0.292s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:37 devstack sudo[90854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe.info
Nov 05 09:30:37 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:38 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe.info" returned: 0 in 0.267s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:38 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe.info is being set with open permissions: ugo+rw
Nov 05 09:30:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:38 devstack sudo[90857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe.info
Nov 05 09:30:38 devstack sudo[90857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:38 devstack sudo[90857]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe.info" returned: 0 in 0.252s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Acquiring lock "cinder-quobyte-a72dd19f-3cd3-47dd-92da-bf8dc34f8b48" by "_copy_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:30:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Lock "cinder-quobyte-a72dd19f-3cd3-47dd-92da-bf8dc34f8b48" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:30:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] snapshot: 137d34ab-04ea-419f-8569-d17a2f1beb34, volume: a72dd19f-3cd3-47dd-92da-bf8dc34f8b48,  {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 09:30:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:30:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:30:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:30:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:30:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:30:38 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[3227b62f-47ce-46af-aee8-2311ddb622da]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:30:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe.137d34ab-04ea-419f-8569-d17a2f1beb34 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:38 devstack sudo[90860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe.137d34ab-04ea-419f-8569-d17a2f1beb34
Nov 05 09:30:38 devstack sudo[90860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:38 devstack sudo[90860]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe.137d34ab-04ea-419f-8569-d17a2f1beb34" returned: 0 in 0.366s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3190de1-bc6e-437f-b252-98505d73cdfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:30:38 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce3bb3a-9fa2-484e-b0b0-24135ca07b0f]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:30:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:38 devstack sudo[90866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe
Nov 05 09:30:38 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:39 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe" returned: 0 in 0.389s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 09:30:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Creating direct copy from snapshot {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 09:30:39 devstack cinder-volume[86649]: DEBUG cinder.utils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Path /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a72dd19f-3cd3-47dd-92da-bf8dc34f8b48 not found in is_blk_device check {{(pid=86649) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 09:30:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a72dd19f-3cd3-47dd-92da-bf8dc34f8b48 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:39 devstack sudo[90871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a72dd19f-3cd3-47dd-92da-bf8dc34f8b48
Nov 05 09:30:39 devstack sudo[90871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-1b37e7f9-380a-476b-af5a-ef75f71c5feb req-738fb237-1f46-4d50-b62a-c6beb8f28574 tempest-ServerActionsTestOtherA-1591449576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:30:46 devstack sudo[90871]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a72dd19f-3cd3-47dd-92da-bf8dc34f8b48" returned: 0 in 6.951s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:46 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Image conversion details: src /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe, size 1024.00 MB, duration 6.95 sec, destination /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a72dd19f-3cd3-47dd-92da-bf8dc34f8b48 {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 09:30:46 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Converted 1024.00 MB image at 147.30 MB/s
Nov 05 09:30:46 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a72dd19f-3cd3-47dd-92da-bf8dc34f8b48 is being set with open permissions: ugo+rw
Nov 05 09:30:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a72dd19f-3cd3-47dd-92da-bf8dc34f8b48 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:46 devstack sudo[90905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a72dd19f-3cd3-47dd-92da-bf8dc34f8b48
Nov 05 09:30:46 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:46 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a72dd19f-3cd3-47dd-92da-bf8dc34f8b48" returned: 0 in 0.260s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Lock "cinder-quobyte-a72dd19f-3cd3-47dd-92da-bf8dc34f8b48" released by "_copy_volume_from_snapshot" :: held 8.039s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:30:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Acquiring lock "cinder-quobyte-137d34ab-04ea-419f-8569-d17a2f1beb34" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:30:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Lock "cinder-quobyte-137d34ab-04ea-419f-8569-d17a2f1beb34" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:30:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Deleting offline snapshot 137d34ab-04ea-419f-8569-d17a2f1beb34 of volume f3190de1-bc6e-437f-b252-98505d73cdfe {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 09:30:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] snapshot_file for this snap is: volume-f3190de1-bc6e-437f-b252-98505d73cdfe.137d34ab-04ea-419f-8569-d17a2f1beb34 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 09:30:46 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f36744b-6208-4080-8038-0d963bfe8535]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:30:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe.137d34ab-04ea-419f-8569-d17a2f1beb34 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:46 devstack sudo[90908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe.137d34ab-04ea-419f-8569-d17a2f1beb34
Nov 05 09:30:46 devstack sudo[90908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:46 devstack sudo[90908]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe.137d34ab-04ea-419f-8569-d17a2f1beb34" returned: 0 in 0.374s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3190de1-bc6e-437f-b252-98505d73cdfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:30:46 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff78863-2bda-412d-be38-280c62f84150]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:30:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:47 devstack sudo[90913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe
Nov 05 09:30:47 devstack sudo[90913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:47 devstack sudo[90913]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe" returned: 0 in 0.556s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe.137d34ab-04ea-419f-8569-d17a2f1beb34 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:47 devstack sudo[90918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe.137d34ab-04ea-419f-8569-d17a2f1beb34
Nov 05 09:30:47 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:47 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe.137d34ab-04ea-419f-8569-d17a2f1beb34" returned: 0 in 0.352s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe.137d34ab-04ea-419f-8569-d17a2f1beb34 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:47 devstack sudo[90924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe.137d34ab-04ea-419f-8569-d17a2f1beb34
Nov 05 09:30:47 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:48 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe.137d34ab-04ea-419f-8569-d17a2f1beb34" returned: 0 in 0.246s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Lock "cinder-quobyte-137d34ab-04ea-419f-8569-d17a2f1beb34" released by "_delete_snapshot" :: held 1.636s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:30:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.806s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:30:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-1b37e7f9-380a-476b-af5a-ef75f71c5feb req-738fb237-1f46-4d50-b62a-c6beb8f28574 tempest-ServerActionsTestOtherA-1591449576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.852s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:30:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-1b37e7f9-380a-476b-af5a-ef75f71c5feb req-738fb237-1f46-4d50-b62a-c6beb8f28574 tempest-ServerActionsTestOtherA-1591449576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:30:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (126dc07b-f897-492b-9b58-b16e9d39ba4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a72dd19f-3cd3-47dd-92da-bf8dc34f8b48', 'volume_size': 2, 'source_volid': 'f3190de1-bc6e-437f-b252-98505d73cdfe', 'source_volstatus': 'available'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:30:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50251f1f-a678-4690-b2df-89a40efdde4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:48 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Volume volume-a72dd19f-3cd3-47dd-92da-bf8dc34f8b48 (a72dd19f-3cd3-47dd-92da-bf8dc34f8b48): created successfully
Nov 05 09:30:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50251f1f-a678-4690-b2df-89a40efdde4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:30:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Flow 'volume_create_manager' (d4ad04ca-c67f-4e9d-94f7-b57bb850778e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:30:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-1b37e7f9-380a-476b-af5a-ef75f71c5feb req-738fb237-1f46-4d50-b62a-c6beb8f28574 tempest-ServerActionsTestOtherA-1591449576 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1', 'name': 'volume-60ab7b69-ae03-4977-bb12-2b5cdfc47e91', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '75bcb733-7775-4aec-9e16-0e13c648d6d4', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 09:30:48 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-81cbed50-6adf-4284-84df-3c0fdc74c2ab tempest-VolumesCloneTest-477093319 None] Created volume successfully.
Nov 05 09:30:48 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-1b37e7f9-380a-476b-af5a-ef75f71c5feb req-738fb237-1f46-4d50-b62a-c6beb8f28574 tempest-ServerActionsTestOtherA-1591449576 None] attachment_update completed successfully.
Nov 05 09:30:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5237d5dd-ed5f-4832-8faf-445f800c80e7 tempest-VolumesCloneTest-477093319 None] Acquiring lock "cinder-a72dd19f-3cd3-47dd-92da-bf8dc34f8b48-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:30:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5237d5dd-ed5f-4832-8faf-445f800c80e7 tempest-VolumesCloneTest-477093319 None] Lock "cinder-a72dd19f-3cd3-47dd-92da-bf8dc34f8b48-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:30:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5237d5dd-ed5f-4832-8faf-445f800c80e7 tempest-VolumesCloneTest-477093319 None] Acquiring lock "cinder-quobyte-a72dd19f-3cd3-47dd-92da-bf8dc34f8b48" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:30:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5237d5dd-ed5f-4832-8faf-445f800c80e7 tempest-VolumesCloneTest-477093319 None] Lock "cinder-quobyte-a72dd19f-3cd3-47dd-92da-bf8dc34f8b48" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:30:49 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc7eb1b-f490-4414-9f3f-501b4f71b55d]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:30:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5237d5dd-ed5f-4832-8faf-445f800c80e7 tempest-VolumesCloneTest-477093319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a72dd19f-3cd3-47dd-92da-bf8dc34f8b48 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:49 devstack sudo[91344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a72dd19f-3cd3-47dd-92da-bf8dc34f8b48
Nov 05 09:30:49 devstack sudo[91344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:49 devstack sudo[91344]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5237d5dd-ed5f-4832-8faf-445f800c80e7 tempest-VolumesCloneTest-477093319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a72dd19f-3cd3-47dd-92da-bf8dc34f8b48" returned: 0 in 0.413s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5237d5dd-ed5f-4832-8faf-445f800c80e7 tempest-VolumesCloneTest-477093319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a72dd19f-3cd3-47dd-92da-bf8dc34f8b48 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:49 devstack sudo[91349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a72dd19f-3cd3-47dd-92da-bf8dc34f8b48
Nov 05 09:30:49 devstack sudo[91349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:50 devstack sudo[91349]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5237d5dd-ed5f-4832-8faf-445f800c80e7 tempest-VolumesCloneTest-477093319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a72dd19f-3cd3-47dd-92da-bf8dc34f8b48" returned: 0 in 0.287s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5237d5dd-ed5f-4832-8faf-445f800c80e7 tempest-VolumesCloneTest-477093319 None] Lock "cinder-quobyte-a72dd19f-3cd3-47dd-92da-bf8dc34f8b48" released by "delete_volume" :: held 0.763s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:30:50 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-5237d5dd-ed5f-4832-8faf-445f800c80e7 tempest-VolumesCloneTest-477093319 None] Created reservations ['ca8c390f-101a-463f-b933-a3757e521fc7', '0d1f3e27-7952-4b30-a899-1e398bd633a6', '97d15a81-bb0e-4ce7-858b-cfd9c91b38cf', 'b0339ad0-7852-47bb-942e-d9abce77ca51'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:30:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5237d5dd-ed5f-4832-8faf-445f800c80e7 tempest-VolumesCloneTest-477093319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:30:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5237d5dd-ed5f-4832-8faf-445f800c80e7 tempest-VolumesCloneTest-477093319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:30:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5237d5dd-ed5f-4832-8faf-445f800c80e7 tempest-VolumesCloneTest-477093319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:30:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5237d5dd-ed5f-4832-8faf-445f800c80e7 tempest-VolumesCloneTest-477093319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:30:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5237d5dd-ed5f-4832-8faf-445f800c80e7 tempest-VolumesCloneTest-477093319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:30:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5237d5dd-ed5f-4832-8faf-445f800c80e7 tempest-VolumesCloneTest-477093319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:50 devstack sudo[91353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:30:50 devstack sudo[91353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ebcc89c0-817c-4f19-8d0f-1e18945817db tempest-VolumesCloneTest-477093319 None] Acquiring lock "cinder-f3190de1-bc6e-437f-b252-98505d73cdfe-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:30:50 devstack sudo[91353]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5237d5dd-ed5f-4832-8faf-445f800c80e7 tempest-VolumesCloneTest-477093319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.325s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:50 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-5237d5dd-ed5f-4832-8faf-445f800c80e7 tempest-VolumesCloneTest-477093319 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:30:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ebcc89c0-817c-4f19-8d0f-1e18945817db tempest-VolumesCloneTest-477093319 None] Lock "cinder-f3190de1-bc6e-437f-b252-98505d73cdfe-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:30:50 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-5237d5dd-ed5f-4832-8faf-445f800c80e7 tempest-VolumesCloneTest-477093319 None] Deleted volume successfully.
Nov 05 09:30:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5237d5dd-ed5f-4832-8faf-445f800c80e7 tempest-VolumesCloneTest-477093319 None] Lock "cinder-a72dd19f-3cd3-47dd-92da-bf8dc34f8b48-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:30:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ebcc89c0-817c-4f19-8d0f-1e18945817db tempest-VolumesCloneTest-477093319 None] Acquiring lock "cinder-quobyte-f3190de1-bc6e-437f-b252-98505d73cdfe" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:30:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ebcc89c0-817c-4f19-8d0f-1e18945817db tempest-VolumesCloneTest-477093319 None] Lock "cinder-quobyte-f3190de1-bc6e-437f-b252-98505d73cdfe" acquired by "delete_volume" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:30:50 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[a562517d-a7e5-4959-8915-68fe84cca378]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:30:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ebcc89c0-817c-4f19-8d0f-1e18945817db tempest-VolumesCloneTest-477093319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:50 devstack sudo[91358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe
Nov 05 09:30:50 devstack sudo[91358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:51 devstack sudo[91358]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ebcc89c0-817c-4f19-8d0f-1e18945817db tempest-VolumesCloneTest-477093319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe" returned: 0 in 0.417s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ebcc89c0-817c-4f19-8d0f-1e18945817db tempest-VolumesCloneTest-477093319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:51 devstack sudo[91368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe
Nov 05 09:30:51 devstack sudo[91368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:51 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-295b13e5-9e20-4b7b-b26f-d3687d247db9 req-5d86ce48-38db-4820-9ea6-54b8f2f113c1 tempest-ServerActionsTestOtherA-1591449576 None] Terminate volume connection completed successfully.
Nov 05 09:30:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-295b13e5-9e20-4b7b-b26f-d3687d247db9 req-5d86ce48-38db-4820-9ea6-54b8f2f113c1 tempest-ServerActionsTestOtherA-1591449576 None] Deleting attachment 75bcb733-7775-4aec-9e16-0e13c648d6d4. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 09:30:51 devstack sudo[91368]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ebcc89c0-817c-4f19-8d0f-1e18945817db tempest-VolumesCloneTest-477093319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f3190de1-bc6e-437f-b252-98505d73cdfe" returned: 0 in 0.306s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ebcc89c0-817c-4f19-8d0f-1e18945817db tempest-VolumesCloneTest-477093319 None] Lock "cinder-quobyte-f3190de1-bc6e-437f-b252-98505d73cdfe" released by "delete_volume" :: held 0.797s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:30:51 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-ebcc89c0-817c-4f19-8d0f-1e18945817db tempest-VolumesCloneTest-477093319 None] Created reservations ['acf7a3cf-9a41-4539-8e9e-aa146d5c0284', '02d34bf0-f4d0-4bee-93ba-c5e3faa2b64f', 'b8be92f1-2d88-4f71-bf9f-d845ac5701a6', '724b873f-634e-483c-b163-71fd1879995b'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:30:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ebcc89c0-817c-4f19-8d0f-1e18945817db tempest-VolumesCloneTest-477093319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:30:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ebcc89c0-817c-4f19-8d0f-1e18945817db tempest-VolumesCloneTest-477093319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:30:51 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ebcc89c0-817c-4f19-8d0f-1e18945817db tempest-VolumesCloneTest-477093319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:30:51 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ebcc89c0-817c-4f19-8d0f-1e18945817db tempest-VolumesCloneTest-477093319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:30:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ebcc89c0-817c-4f19-8d0f-1e18945817db tempest-VolumesCloneTest-477093319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:30:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ebcc89c0-817c-4f19-8d0f-1e18945817db tempest-VolumesCloneTest-477093319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:51 devstack sudo[91402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:30:51 devstack sudo[91402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:52 devstack sudo[91402]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ebcc89c0-817c-4f19-8d0f-1e18945817db tempest-VolumesCloneTest-477093319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.525s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:52 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-ebcc89c0-817c-4f19-8d0f-1e18945817db tempest-VolumesCloneTest-477093319 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:30:52 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ebcc89c0-817c-4f19-8d0f-1e18945817db tempest-VolumesCloneTest-477093319 None] Deleted volume successfully.
Nov 05 09:30:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ebcc89c0-817c-4f19-8d0f-1e18945817db tempest-VolumesCloneTest-477093319 None] Lock "cinder-f3190de1-bc6e-437f-b252-98505d73cdfe-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:30:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-295b13e5-9e20-4b7b-b26f-d3687d247db9 req-f5bc0564-2afc-4343-b574-2a633c16acf6 tempest-ServerActionsTestOtherA-1591449576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:30:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-295b13e5-9e20-4b7b-b26f-d3687d247db9 req-f5bc0564-2afc-4343-b574-2a633c16acf6 tempest-ServerActionsTestOtherA-1591449576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:30:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-295b13e5-9e20-4b7b-b26f-d3687d247db9 req-f5bc0564-2afc-4343-b574-2a633c16acf6 tempest-ServerActionsTestOtherA-1591449576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:30:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-295b13e5-9e20-4b7b-b26f-d3687d247db9 req-f5bc0564-2afc-4343-b574-2a633c16acf6 tempest-ServerActionsTestOtherA-1591449576 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1', 'name': 'volume-60ab7b69-ae03-4977-bb12-2b5cdfc47e91', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2fa4ed39-89a8-4716-9c16-346e93db1561', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 09:30:52 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-295b13e5-9e20-4b7b-b26f-d3687d247db9 req-f5bc0564-2afc-4343-b574-2a633c16acf6 tempest-ServerActionsTestOtherA-1591449576 None] attachment_update completed successfully.
Nov 05 09:30:58 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:30:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] Flow 'volume_create_manager' (08309154-363c-4acb-8e93-91f919d2615e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:30:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9249232b-51e3-4ff1-8ca5-2e72bbdd2ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9249232b-51e3-4ff1-8ca5-2e72bbdd2ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-638700524',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6794056-88a2-4bb5-9061-8f216fb3ede0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f8ae6e11539416bac871d452325d77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:30:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:30:58Z,use_quota=True,user_id='12c193c0d75b414f98eeaa924e60f21f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:30:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a4609e9-9b65-4db0-a795-c2f877aa842d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a4609e9-9b65-4db0-a795-c2f877aa842d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:30:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce7b95d-2772-4a95-8a2b-b88628beba52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce7b95d-2772-4a95-8a2b-b88628beba52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6794056-88a2-4bb5-9061-8f216fb3ede0', 'volume_name': 'volume-c6794056-88a2-4bb5-9061-8f216fb3ede0', 'volume_size': 2}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:30:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c83c1971-6ef1-44da-8fa5-e9c5fb619bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c83c1971-6ef1-44da-8fa5-e9c5fb619bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:30:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbfa2433-b7be-4583-a269-4eafb6fef2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:30:58 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] Volume c6794056-88a2-4bb5-9061-8f216fb3ede0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6794056-88a2-4bb5-9061-8f216fb3ede0', 'volume_size': 2}
Nov 05 09:30:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:30:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:30:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-638700524',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6794056-88a2-4bb5-9061-8f216fb3ede0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f8ae6e11539416bac871d452325d77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:30:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:30:58Z,use_quota=True,user_id='12c193c0d75b414f98eeaa924e60f21f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:30:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] Creating volume c6794056-88a2-4bb5-9061-8f216fb3ede0 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:30:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:30:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:30:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:30:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:30:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:30:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:30:58 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:30:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6794056-88a2-4bb5-9061-8f216fb3ede0 2147483648 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:58 devstack sudo[91956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6794056-88a2-4bb5-9061-8f216fb3ede0 2147483648
Nov 05 09:30:58 devstack sudo[91956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:30:59 devstack sudo[91956]: pam_unix(sudo:session): session closed for user root
Nov 05 09:30:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6794056-88a2-4bb5-9061-8f216fb3ede0 2147483648" returned: 0 in 1.022s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:30:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6794056-88a2-4bb5-9061-8f216fb3ede0 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:30:59 devstack sudo[91990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6794056-88a2-4bb5-9061-8f216fb3ede0
Nov 05 09:30:59 devstack sudo[91990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:00 devstack sudo[91990]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6794056-88a2-4bb5-9061-8f216fb3ede0" returned: 0 in 0.354s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:31:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:31:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbfa2433-b7be-4583-a269-4eafb6fef2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6794056-88a2-4bb5-9061-8f216fb3ede0', 'volume_size': 2}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57a44c60-c11e-4613-b59c-b1655dfbc6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:00 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] Volume volume-c6794056-88a2-4bb5-9061-8f216fb3ede0 (c6794056-88a2-4bb5-9061-8f216fb3ede0): created successfully
Nov 05 09:31:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57a44c60-c11e-4613-b59c-b1655dfbc6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] Flow 'volume_create_manager' (08309154-363c-4acb-8e93-91f919d2615e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:31:00 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-39a505a7-e934-4821-89ec-469c7248d972 tempest-VolumesCloneNegativeTest-1402725465 None] Created volume successfully.
Nov 05 09:31:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:31:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:31:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:31:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:31:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:31:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:31:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:00 devstack sudo[91999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:31:00 devstack sudo[91999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:00 devstack sudo[91999]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.275s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:31:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:31:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 8 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:31:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:31:00 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dad05aac-66b0-41ba-b57d-e56a3dc30b2c tempest-VolumesCloneNegativeTest-1402725465 None] Acquiring lock "cinder-c6794056-88a2-4bb5-9061-8f216fb3ede0-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:31:00 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dad05aac-66b0-41ba-b57d-e56a3dc30b2c tempest-VolumesCloneNegativeTest-1402725465 None] Lock "cinder-c6794056-88a2-4bb5-9061-8f216fb3ede0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:31:00 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dad05aac-66b0-41ba-b57d-e56a3dc30b2c tempest-VolumesCloneNegativeTest-1402725465 None] Acquiring lock "cinder-quobyte-c6794056-88a2-4bb5-9061-8f216fb3ede0" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:31:00 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dad05aac-66b0-41ba-b57d-e56a3dc30b2c tempest-VolumesCloneNegativeTest-1402725465 None] Lock "cinder-quobyte-c6794056-88a2-4bb5-9061-8f216fb3ede0" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:31:00 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f96cf1-7ffb-4029-aa2a-6efb5da7f74e]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:31:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dad05aac-66b0-41ba-b57d-e56a3dc30b2c tempest-VolumesCloneNegativeTest-1402725465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6794056-88a2-4bb5-9061-8f216fb3ede0 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:01 devstack sudo[92004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6794056-88a2-4bb5-9061-8f216fb3ede0
Nov 05 09:31:01 devstack sudo[92004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:01 devstack sudo[92004]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dad05aac-66b0-41ba-b57d-e56a3dc30b2c tempest-VolumesCloneNegativeTest-1402725465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6794056-88a2-4bb5-9061-8f216fb3ede0" returned: 0 in 0.477s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dad05aac-66b0-41ba-b57d-e56a3dc30b2c tempest-VolumesCloneNegativeTest-1402725465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6794056-88a2-4bb5-9061-8f216fb3ede0 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:01 devstack sudo[92010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6794056-88a2-4bb5-9061-8f216fb3ede0
Nov 05 09:31:01 devstack sudo[92010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:01 devstack sudo[92010]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dad05aac-66b0-41ba-b57d-e56a3dc30b2c tempest-VolumesCloneNegativeTest-1402725465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6794056-88a2-4bb5-9061-8f216fb3ede0" returned: 0 in 0.278s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dad05aac-66b0-41ba-b57d-e56a3dc30b2c tempest-VolumesCloneNegativeTest-1402725465 None] Lock "cinder-quobyte-c6794056-88a2-4bb5-9061-8f216fb3ede0" released by "delete_volume" :: held 0.832s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:31:01 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-dad05aac-66b0-41ba-b57d-e56a3dc30b2c tempest-VolumesCloneNegativeTest-1402725465 None] Created reservations ['968f4ebd-155b-4e79-a070-9e2333b64ce0', 'd3bba1fd-db38-4773-a4f2-73c4237d1074', '5afa416f-c403-45fb-a604-0ca7a192dfb1', 'bcd09d6a-f9a2-463b-b6dd-d5ed3e10044d'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:31:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dad05aac-66b0-41ba-b57d-e56a3dc30b2c tempest-VolumesCloneNegativeTest-1402725465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:31:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dad05aac-66b0-41ba-b57d-e56a3dc30b2c tempest-VolumesCloneNegativeTest-1402725465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:31:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dad05aac-66b0-41ba-b57d-e56a3dc30b2c tempest-VolumesCloneNegativeTest-1402725465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:31:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dad05aac-66b0-41ba-b57d-e56a3dc30b2c tempest-VolumesCloneNegativeTest-1402725465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:31:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dad05aac-66b0-41ba-b57d-e56a3dc30b2c tempest-VolumesCloneNegativeTest-1402725465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:31:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dad05aac-66b0-41ba-b57d-e56a3dc30b2c tempest-VolumesCloneNegativeTest-1402725465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:01 devstack sudo[92013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:31:01 devstack sudo[92013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:02 devstack sudo[92013]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dad05aac-66b0-41ba-b57d-e56a3dc30b2c tempest-VolumesCloneNegativeTest-1402725465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.341s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:02 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-dad05aac-66b0-41ba-b57d-e56a3dc30b2c tempest-VolumesCloneNegativeTest-1402725465 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:31:02 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-dad05aac-66b0-41ba-b57d-e56a3dc30b2c tempest-VolumesCloneNegativeTest-1402725465 None] Deleted volume successfully.
Nov 05 09:31:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dad05aac-66b0-41ba-b57d-e56a3dc30b2c tempest-VolumesCloneNegativeTest-1402725465 None] Lock "cinder-c6794056-88a2-4bb5-9061-8f216fb3ede0-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:31:10 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:31:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] Flow 'volume_create_manager' (1ec8162c-5be9-4cdf-89a9-9b56ed5555cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:31:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c5c2ec1-b77f-4a58-83ae-5f7eb99f11b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c5c2ec1-b77f-4a58-83ae-5f7eb99f11b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-11409283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8700bf4f-e101-4dba-8fb4-28e0092c062d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='340e92f791744daa815d24fa5dba7d5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:31:10Z,use_quota=True,user_id='af6627fdb60841e4b282fee927d24970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56326a86-ec6e-400d-9b02-fb75113ee545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56326a86-ec6e-400d-9b02-fb75113ee545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (239d0bcf-933d-4e46-9519-d6aa2565c8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (239d0bcf-933d-4e46-9519-d6aa2565c8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8700bf4f-e101-4dba-8fb4-28e0092c062d', 'volume_name': 'volume-8700bf4f-e101-4dba-8fb4-28e0092c062d', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c85ce1-9295-458d-a061-e95bef4335c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c85ce1-9295-458d-a061-e95bef4335c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f9207c1-3115-4a9c-b0a9-c3d59ef7e74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:10 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] Volume 8700bf4f-e101-4dba-8fb4-28e0092c062d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8700bf4f-e101-4dba-8fb4-28e0092c062d', 'volume_size': 1}
Nov 05 09:31:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:31:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:31:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-11409283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8700bf4f-e101-4dba-8fb4-28e0092c062d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='340e92f791744daa815d24fa5dba7d5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:31:10Z,use_quota=True,user_id='af6627fdb60841e4b282fee927d24970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:31:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] Creating volume 8700bf4f-e101-4dba-8fb4-28e0092c062d {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:31:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:31:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:31:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:31:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:31:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:31:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:31:10 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:31:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8700bf4f-e101-4dba-8fb4-28e0092c062d 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:10 devstack sudo[92046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8700bf4f-e101-4dba-8fb4-28e0092c062d 1073741824
Nov 05 09:31:10 devstack sudo[92046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:11 devstack sudo[92046]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8700bf4f-e101-4dba-8fb4-28e0092c062d 1073741824" returned: 0 in 0.494s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8700bf4f-e101-4dba-8fb4-28e0092c062d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:11 devstack sudo[92052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8700bf4f-e101-4dba-8fb4-28e0092c062d
Nov 05 09:31:11 devstack sudo[92052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:11 devstack sudo[92052]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8700bf4f-e101-4dba-8fb4-28e0092c062d" returned: 0 in 0.295s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:11 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:31:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:31:11 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f9207c1-3115-4a9c-b0a9-c3d59ef7e74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8700bf4f-e101-4dba-8fb4-28e0092c062d', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:11 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b788a5d9-2458-4025-b585-27290abe3ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:11 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] Volume volume-8700bf4f-e101-4dba-8fb4-28e0092c062d (8700bf4f-e101-4dba-8fb4-28e0092c062d): created successfully
Nov 05 09:31:11 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b788a5d9-2458-4025-b585-27290abe3ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:11 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] Flow 'volume_create_manager' (1ec8162c-5be9-4cdf-89a9-9b56ed5555cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:31:11 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-758b2897-3447-48f5-a846-8468eced9047 tempest-VolumesGetTest-1920286987 None] Created volume successfully.
Nov 05 09:31:13 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:31:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] Flow 'volume_create_manager' (924b710e-68d6-4afb-8fe3-325bc317b233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:31:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a41145de-b5e8-496b-81ae-ce35db9a31de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a41145de-b5e8-496b-81ae-ce35db9a31de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:31:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-896240486',display_name='tempest-VolumesGetTest-Volume-237390318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15499867-56ce-44d3-9c57-87ee0c72cbad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='340e92f791744daa815d24fa5dba7d5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:31:14Z,use_quota=True,user_id='af6627fdb60841e4b282fee927d24970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f10d6326-338c-4daa-bb36-50756ea742b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f10d6326-338c-4daa-bb36-50756ea742b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e507c636-e5b9-46ab-bc02-30465c3d4f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e507c636-e5b9-46ab-bc02-30465c3d4f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15499867-56ce-44d3-9c57-87ee0c72cbad', 'volume_name': 'volume-15499867-56ce-44d3-9c57-87ee0c72cbad', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2ecf83-3375-49f1-943b-d2fa3fac6933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2ecf83-3375-49f1-943b-d2fa3fac6933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7943828-a380-4017-bff2-5d868c7d8255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:13 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] Volume 15499867-56ce-44d3-9c57-87ee0c72cbad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15499867-56ce-44d3-9c57-87ee0c72cbad', 'volume_size': 1}
Nov 05 09:31:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:31:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:31:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:31:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-896240486',display_name='tempest-VolumesGetTest-Volume-237390318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15499867-56ce-44d3-9c57-87ee0c72cbad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='340e92f791744daa815d24fa5dba7d5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:31:14Z,use_quota=True,user_id='af6627fdb60841e4b282fee927d24970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:31:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] Creating volume 15499867-56ce-44d3-9c57-87ee0c72cbad {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:31:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:31:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:31:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:31:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:31:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:31:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:31:13 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:31:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-15499867-56ce-44d3-9c57-87ee0c72cbad 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:13 devstack sudo[92055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-15499867-56ce-44d3-9c57-87ee0c72cbad 1073741824
Nov 05 09:31:13 devstack sudo[92055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:14 devstack sudo[92055]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-15499867-56ce-44d3-9c57-87ee0c72cbad 1073741824" returned: 0 in 0.466s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-15499867-56ce-44d3-9c57-87ee0c72cbad {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:14 devstack sudo[92061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-15499867-56ce-44d3-9c57-87ee0c72cbad
Nov 05 09:31:14 devstack sudo[92061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:14 devstack sudo[92061]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-15499867-56ce-44d3-9c57-87ee0c72cbad" returned: 0 in 0.307s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:31:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:31:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7943828-a380-4017-bff2-5d868c7d8255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15499867-56ce-44d3-9c57-87ee0c72cbad', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ebe40aa-c211-4bec-9b3f-b0e6e8249678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:14 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] Volume volume-15499867-56ce-44d3-9c57-87ee0c72cbad (15499867-56ce-44d3-9c57-87ee0c72cbad): created successfully
Nov 05 09:31:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ebe40aa-c211-4bec-9b3f-b0e6e8249678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] Flow 'volume_create_manager' (924b710e-68d6-4afb-8fe3-325bc317b233) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:31:14 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-5c08d774-b83a-49bd-82d2-b6f899e6929c tempest-VolumesGetTest-1920286987 None] Created volume successfully.
Nov 05 09:31:16 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8ea4eee9-1a78-493b-91bd-5015a9d9deec tempest-VolumesGetTest-1920286987 None] Acquiring lock "cinder-15499867-56ce-44d3-9c57-87ee0c72cbad-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:31:16 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8ea4eee9-1a78-493b-91bd-5015a9d9deec tempest-VolumesGetTest-1920286987 None] Lock "cinder-15499867-56ce-44d3-9c57-87ee0c72cbad-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:31:16 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8ea4eee9-1a78-493b-91bd-5015a9d9deec tempest-VolumesGetTest-1920286987 None] Acquiring lock "cinder-quobyte-15499867-56ce-44d3-9c57-87ee0c72cbad" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:31:16 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8ea4eee9-1a78-493b-91bd-5015a9d9deec tempest-VolumesGetTest-1920286987 None] Lock "cinder-quobyte-15499867-56ce-44d3-9c57-87ee0c72cbad" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:31:16 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[28882f74-9475-419d-97b5-e51ce5a96bd1]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:31:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8ea4eee9-1a78-493b-91bd-5015a9d9deec tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-15499867-56ce-44d3-9c57-87ee0c72cbad {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:16 devstack sudo[92089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-15499867-56ce-44d3-9c57-87ee0c72cbad
Nov 05 09:31:16 devstack sudo[92089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:16 devstack sudo[92089]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8ea4eee9-1a78-493b-91bd-5015a9d9deec tempest-VolumesGetTest-1920286987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-15499867-56ce-44d3-9c57-87ee0c72cbad" returned: 0 in 0.378s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8ea4eee9-1a78-493b-91bd-5015a9d9deec tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-15499867-56ce-44d3-9c57-87ee0c72cbad {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:16 devstack sudo[92094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-15499867-56ce-44d3-9c57-87ee0c72cbad
Nov 05 09:31:16 devstack sudo[92094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:16 devstack sudo[92094]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8ea4eee9-1a78-493b-91bd-5015a9d9deec tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-15499867-56ce-44d3-9c57-87ee0c72cbad" returned: 0 in 0.290s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:16 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8ea4eee9-1a78-493b-91bd-5015a9d9deec tempest-VolumesGetTest-1920286987 None] Lock "cinder-quobyte-15499867-56ce-44d3-9c57-87ee0c72cbad" released by "delete_volume" :: held 0.710s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:31:16 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=57,cinder:UPDATE=64,cinder:DELETE=6,cinder:INSERT=14 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:31:16 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=69,cinder:SELECT=61,cinder:INSERT=15,cinder:DELETE=6 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:31:16 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-8ea4eee9-1a78-493b-91bd-5015a9d9deec tempest-VolumesGetTest-1920286987 None] Created reservations ['5327eae7-0dfd-4fe2-85be-0219fb6ce26e', '0d57569c-18a9-4606-a8bb-b15b49dadbcd', '9df8e585-abe1-4622-b36b-767cfba3287d', '16040b96-ba65-4944-a80f-0fbfb6f21c73'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:31:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8ea4eee9-1a78-493b-91bd-5015a9d9deec tempest-VolumesGetTest-1920286987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:31:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8ea4eee9-1a78-493b-91bd-5015a9d9deec tempest-VolumesGetTest-1920286987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:31:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8ea4eee9-1a78-493b-91bd-5015a9d9deec tempest-VolumesGetTest-1920286987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:31:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8ea4eee9-1a78-493b-91bd-5015a9d9deec tempest-VolumesGetTest-1920286987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:31:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8ea4eee9-1a78-493b-91bd-5015a9d9deec tempest-VolumesGetTest-1920286987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:31:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8ea4eee9-1a78-493b-91bd-5015a9d9deec tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:17 devstack sudo[92097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:31:17 devstack sudo[92097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:17 devstack sudo[92097]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8ea4eee9-1a78-493b-91bd-5015a9d9deec tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.295s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:17 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-8ea4eee9-1a78-493b-91bd-5015a9d9deec tempest-VolumesGetTest-1920286987 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:31:17 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-8ea4eee9-1a78-493b-91bd-5015a9d9deec tempest-VolumesGetTest-1920286987 None] Deleted volume successfully.
Nov 05 09:31:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-94ce5874-cbad-4082-beb5-ff57a718aa17 tempest-VolumesGetTest-1920286987 None] Acquiring lock "cinder-8700bf4f-e101-4dba-8fb4-28e0092c062d-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:31:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8ea4eee9-1a78-493b-91bd-5015a9d9deec tempest-VolumesGetTest-1920286987 None] Lock "cinder-15499867-56ce-44d3-9c57-87ee0c72cbad-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:31:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-94ce5874-cbad-4082-beb5-ff57a718aa17 tempest-VolumesGetTest-1920286987 None] Lock "cinder-8700bf4f-e101-4dba-8fb4-28e0092c062d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:31:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-94ce5874-cbad-4082-beb5-ff57a718aa17 tempest-VolumesGetTest-1920286987 None] Acquiring lock "cinder-quobyte-8700bf4f-e101-4dba-8fb4-28e0092c062d" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:31:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-94ce5874-cbad-4082-beb5-ff57a718aa17 tempest-VolumesGetTest-1920286987 None] Lock "cinder-quobyte-8700bf4f-e101-4dba-8fb4-28e0092c062d" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:31:17 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d207618-1756-4b31-8370-23ebb0148781]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:31:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-94ce5874-cbad-4082-beb5-ff57a718aa17 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8700bf4f-e101-4dba-8fb4-28e0092c062d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:17 devstack sudo[92100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8700bf4f-e101-4dba-8fb4-28e0092c062d
Nov 05 09:31:17 devstack sudo[92100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:17 devstack sudo[92100]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-94ce5874-cbad-4082-beb5-ff57a718aa17 tempest-VolumesGetTest-1920286987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8700bf4f-e101-4dba-8fb4-28e0092c062d" returned: 0 in 0.390s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-94ce5874-cbad-4082-beb5-ff57a718aa17 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8700bf4f-e101-4dba-8fb4-28e0092c062d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:17 devstack sudo[92105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8700bf4f-e101-4dba-8fb4-28e0092c062d
Nov 05 09:31:17 devstack sudo[92105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:18 devstack sudo[92105]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-94ce5874-cbad-4082-beb5-ff57a718aa17 tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8700bf4f-e101-4dba-8fb4-28e0092c062d" returned: 0 in 0.261s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-94ce5874-cbad-4082-beb5-ff57a718aa17 tempest-VolumesGetTest-1920286987 None] Lock "cinder-quobyte-8700bf4f-e101-4dba-8fb4-28e0092c062d" released by "delete_volume" :: held 0.698s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:31:18 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-94ce5874-cbad-4082-beb5-ff57a718aa17 tempest-VolumesGetTest-1920286987 None] Created reservations ['81e6fe2d-ea01-4b94-a257-5d4e4f896c0a', '09285017-f278-490b-8ecc-423f7d3fdf27', '761aff66-8a4a-453b-b212-5219626379ad', '4e4538a8-aec5-4482-90a3-6c8e4eb6f93f'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:31:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-94ce5874-cbad-4082-beb5-ff57a718aa17 tempest-VolumesGetTest-1920286987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:31:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-94ce5874-cbad-4082-beb5-ff57a718aa17 tempest-VolumesGetTest-1920286987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:31:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-94ce5874-cbad-4082-beb5-ff57a718aa17 tempest-VolumesGetTest-1920286987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:31:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-94ce5874-cbad-4082-beb5-ff57a718aa17 tempest-VolumesGetTest-1920286987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:31:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-94ce5874-cbad-4082-beb5-ff57a718aa17 tempest-VolumesGetTest-1920286987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:31:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-94ce5874-cbad-4082-beb5-ff57a718aa17 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:18 devstack sudo[92108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:31:18 devstack sudo[92108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:18 devstack sudo[92108]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-94ce5874-cbad-4082-beb5-ff57a718aa17 tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.276s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:18 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-94ce5874-cbad-4082-beb5-ff57a718aa17 tempest-VolumesGetTest-1920286987 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:31:18 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-94ce5874-cbad-4082-beb5-ff57a718aa17 tempest-VolumesGetTest-1920286987 None] Deleted volume successfully.
Nov 05 09:31:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-94ce5874-cbad-4082-beb5-ff57a718aa17 tempest-VolumesGetTest-1920286987 None] Lock "cinder-8700bf4f-e101-4dba-8fb4-28e0092c062d-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:31:18 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:31:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] Flow 'volume_create_manager' (d231f1a5-fe29-4385-a76e-311df4860393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:31:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b817a5ca-ae49-4f26-a321-91c6160f7a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b817a5ca-ae49-4f26-a321-91c6160f7a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1463444525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd30a236-c2b2-47fa-b417-ddc4504fa116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='340e92f791744daa815d24fa5dba7d5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:31:19Z,use_quota=True,user_id='af6627fdb60841e4b282fee927d24970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e34497ef-66ac-4c67-9b56-d8eec3176941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e34497ef-66ac-4c67-9b56-d8eec3176941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f49bbb1-748a-4db1-ad0e-b86afe4a43f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f49bbb1-748a-4db1-ad0e-b86afe4a43f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd30a236-c2b2-47fa-b417-ddc4504fa116', 'volume_name': 'volume-dd30a236-c2b2-47fa-b417-ddc4504fa116', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ece0e7c1-3890-4c7a-9f2a-92049fca779c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ece0e7c1-3890-4c7a-9f2a-92049fca779c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (932cf785-0710-4d4a-9608-9c348135af3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:19 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] Volume dd30a236-c2b2-47fa-b417-ddc4504fa116: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd30a236-c2b2-47fa-b417-ddc4504fa116', 'volume_size': 1}
Nov 05 09:31:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:31:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:31:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1463444525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd30a236-c2b2-47fa-b417-ddc4504fa116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='340e92f791744daa815d24fa5dba7d5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:31:19Z,use_quota=True,user_id='af6627fdb60841e4b282fee927d24970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:31:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] Creating volume dd30a236-c2b2-47fa-b417-ddc4504fa116 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:31:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:31:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:31:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:31:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:31:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:31:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:31:19 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:31:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:19 devstack sudo[92112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116 1073741824
Nov 05 09:31:19 devstack sudo[92112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:19 devstack sudo[92112]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116 1073741824" returned: 0 in 0.623s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:19 devstack sudo[92119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116
Nov 05 09:31:19 devstack sudo[92119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:20 devstack sudo[92119]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116" returned: 0 in 0.294s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:31:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:31:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (932cf785-0710-4d4a-9608-9c348135af3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd30a236-c2b2-47fa-b417-ddc4504fa116', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (448aef80-ffe1-4519-b32d-e259b6f6878c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:20 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] Volume volume-dd30a236-c2b2-47fa-b417-ddc4504fa116 (dd30a236-c2b2-47fa-b417-ddc4504fa116): created successfully
Nov 05 09:31:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (448aef80-ffe1-4519-b32d-e259b6f6878c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] Flow 'volume_create_manager' (d231f1a5-fe29-4385-a76e-311df4860393) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:31:20 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-4e43ab98-1e71-496b-9dd8-e07aceeb1bfe tempest-VolumesGetTest-1920286987 None] Created volume successfully.
Nov 05 09:31:21 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:31:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Flow 'volume_create_manager' (d206e479-8a2d-494d-831c-df55840b3817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:31:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da33a8b5-aeea-4f7a-852c-56a83fc7fb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da33a8b5-aeea-4f7a-852c-56a83fc7fb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1340385879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcdf1900-e98d-4dc7-842a-9b97f2e15b42,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='340e92f791744daa815d24fa5dba7d5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=dd30a236-c2b2-47fa-b417-ddc4504fa116,status='creating',terminated_at=None,updated_at=2026-11-05T08:31:22Z,use_quota=True,user_id='af6627fdb60841e4b282fee927d24970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ea967a-3079-465e-9bd1-5a10f2aed23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ea967a-3079-465e-9bd1-5a10f2aed23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (466f4ce3-55dd-4442-819a-dca47c10fd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (466f4ce3-55dd-4442-819a-dca47c10fd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'bcdf1900-e98d-4dc7-842a-9b97f2e15b42', 'volume_name': 'volume-bcdf1900-e98d-4dc7-842a-9b97f2e15b42', 'volume_size': 1, 'source_volid': 'dd30a236-c2b2-47fa-b417-ddc4504fa116', 'source_volstatus': 'available'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b15fdd-98b7-47a6-b9a7-655cbb7d37f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b15fdd-98b7-47a6-b9a7-655cbb7d37f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae575c9-bf66-4265-b156-1a8a36b1e10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:21 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Volume bcdf1900-e98d-4dc7-842a-9b97f2e15b42: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-bcdf1900-e98d-4dc7-842a-9b97f2e15b42', 'volume_size': 1, 'source_volid': 'dd30a236-c2b2-47fa-b417-ddc4504fa116', 'source_volstatus': 'available'}
Nov 05 09:31:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:31:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:31:21 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Cloning volume dd30a236-c2b2-47fa-b417-ddc4504fa116 to volume bcdf1900-e98d-4dc7-842a-9b97f2e15b42
Nov 05 09:31:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Creating offline snapshot 573761a1-d115-489e-bd08-36ec1da2b9d6 of volume dd30a236-c2b2-47fa-b417-ddc4504fa116 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 09:31:21 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[4902f134-71b9-433a-9b6c-472347c6d9c9]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:31:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:22 devstack sudo[92122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116
Nov 05 09:31:22 devstack sudo[92122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:22 devstack sudo[92122]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116" returned: 0 in 0.412s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116.573761a1-d115-489e-bd08-36ec1da2b9d6 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:22 devstack sudo[92127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116.573761a1-d115-489e-bd08-36ec1da2b9d6 1G
Nov 05 09:31:22 devstack sudo[92127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:22 devstack sudo[92127]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116.573761a1-d115-489e-bd08-36ec1da2b9d6 1G" returned: 0 in 0.493s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd30a236-c2b2-47fa-b417-ddc4504fa116 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116.573761a1-d115-489e-bd08-36ec1da2b9d6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:22 devstack sudo[92133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd30a236-c2b2-47fa-b417-ddc4504fa116 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116.573761a1-d115-489e-bd08-36ec1da2b9d6
Nov 05 09:31:22 devstack sudo[92133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:23 devstack sudo[92133]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd30a236-c2b2-47fa-b417-ddc4504fa116 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116.573761a1-d115-489e-bd08-36ec1da2b9d6" returned: 0 in 0.313s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:23 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116.573761a1-d115-489e-bd08-36ec1da2b9d6 is being set with open permissions: ugo+rw
Nov 05 09:31:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116.573761a1-d115-489e-bd08-36ec1da2b9d6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:23 devstack sudo[92138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116.573761a1-d115-489e-bd08-36ec1da2b9d6
Nov 05 09:31:23 devstack sudo[92138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:23 devstack sudo[92138]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116.573761a1-d115-489e-bd08-36ec1da2b9d6" returned: 0 in 0.260s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:23 devstack sudo[92144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116.info
Nov 05 09:31:23 devstack sudo[92144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:23 devstack sudo[92144]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116.info" returned: 0 in 0.290s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:23 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116.info is being set with open permissions: ugo+rw
Nov 05 09:31:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:23 devstack sudo[92147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116.info
Nov 05 09:31:23 devstack sudo[92147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:24 devstack sudo[92147]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116.info" returned: 0 in 0.296s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:24 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Acquiring lock "cinder-quobyte-bcdf1900-e98d-4dc7-842a-9b97f2e15b42" by "_copy_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:31:24 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Lock "cinder-quobyte-bcdf1900-e98d-4dc7-842a-9b97f2e15b42" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:31:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] snapshot: 573761a1-d115-489e-bd08-36ec1da2b9d6, volume: bcdf1900-e98d-4dc7-842a-9b97f2e15b42,  {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 09:31:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:31:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:31:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:31:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:31:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:31:24 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[66009a3b-774b-40fc-b818-90e5c468a4b5]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:31:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116.573761a1-d115-489e-bd08-36ec1da2b9d6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:24 devstack sudo[92152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116.573761a1-d115-489e-bd08-36ec1da2b9d6
Nov 05 09:31:24 devstack sudo[92152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:24 devstack sudo[92152]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116.573761a1-d115-489e-bd08-36ec1da2b9d6" returned: 0 in 0.490s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd30a236-c2b2-47fa-b417-ddc4504fa116(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:31:24 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[9126a9b2-3f8d-4faf-8225-1f4f9b481613]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:31:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:24 devstack sudo[92159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116
Nov 05 09:31:24 devstack sudo[92159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:25 devstack sudo[92159]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116" returned: 0 in 0.547s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116 {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 09:31:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Creating direct copy from snapshot {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 09:31:25 devstack cinder-volume[86649]: DEBUG cinder.utils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Path /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bcdf1900-e98d-4dc7-842a-9b97f2e15b42 not found in is_blk_device check {{(pid=86649) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 09:31:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bcdf1900-e98d-4dc7-842a-9b97f2e15b42 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:25 devstack sudo[92166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bcdf1900-e98d-4dc7-842a-9b97f2e15b42
Nov 05 09:31:25 devstack sudo[92166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:25 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-4ff47bfb-d813-495b-90fd-0c891d3f98b8 req-a08378c5-8a41-46a0-8d01-a2f606b4c462 tempest-ServerActionsTestOtherA-1591449576 None] Terminate volume connection completed successfully.
Nov 05 09:31:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-4ff47bfb-d813-495b-90fd-0c891d3f98b8 req-a08378c5-8a41-46a0-8d01-a2f606b4c462 tempest-ServerActionsTestOtherA-1591449576 None] Deleting attachment 2fa4ed39-89a8-4716-9c16-346e93db1561. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 09:31:33 devstack sudo[92166]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bcdf1900-e98d-4dc7-842a-9b97f2e15b42" returned: 0 in 8.307s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:33 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Image conversion details: src /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116, size 1024.00 MB, duration 8.31 sec, destination /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bcdf1900-e98d-4dc7-842a-9b97f2e15b42 {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 09:31:33 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Converted 1024.00 MB image at 123.25 MB/s
Nov 05 09:31:33 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bcdf1900-e98d-4dc7-842a-9b97f2e15b42 is being set with open permissions: ugo+rw
Nov 05 09:31:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bcdf1900-e98d-4dc7-842a-9b97f2e15b42 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:33 devstack sudo[92269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bcdf1900-e98d-4dc7-842a-9b97f2e15b42
Nov 05 09:31:33 devstack sudo[92269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:34 devstack sudo[92269]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bcdf1900-e98d-4dc7-842a-9b97f2e15b42" returned: 0 in 0.412s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Lock "cinder-quobyte-bcdf1900-e98d-4dc7-842a-9b97f2e15b42" released by "_copy_volume_from_snapshot" :: held 9.878s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:31:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Acquiring lock "cinder-quobyte-573761a1-d115-489e-bd08-36ec1da2b9d6" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:31:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Lock "cinder-quobyte-573761a1-d115-489e-bd08-36ec1da2b9d6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:31:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Deleting offline snapshot 573761a1-d115-489e-bd08-36ec1da2b9d6 of volume dd30a236-c2b2-47fa-b417-ddc4504fa116 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 09:31:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] snapshot_file for this snap is: volume-dd30a236-c2b2-47fa-b417-ddc4504fa116.573761a1-d115-489e-bd08-36ec1da2b9d6 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 09:31:34 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[98384d73-1c7c-4a16-93a0-9f57ffdf0a13]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:31:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116.573761a1-d115-489e-bd08-36ec1da2b9d6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:34 devstack sudo[92305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116.573761a1-d115-489e-bd08-36ec1da2b9d6
Nov 05 09:31:34 devstack sudo[92305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:34 devstack sudo[92305]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116.573761a1-d115-489e-bd08-36ec1da2b9d6" returned: 0 in 0.606s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd30a236-c2b2-47fa-b417-ddc4504fa116(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:31:34 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6a9fdb-5760-49e1-bba6-fa1519572fff]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:31:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:34 devstack sudo[92339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116
Nov 05 09:31:34 devstack sudo[92339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:35 devstack sudo[92339]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116" returned: 0 in 0.641s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116.573761a1-d115-489e-bd08-36ec1da2b9d6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:35 devstack sudo[92349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116.573761a1-d115-489e-bd08-36ec1da2b9d6
Nov 05 09:31:35 devstack sudo[92349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:35 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=16,cinder:INSERT=6,cinder:UPDATE=17,cinder:DELETE=3 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:31:35 devstack sudo[92349]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116.573761a1-d115-489e-bd08-36ec1da2b9d6" returned: 0 in 0.541s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116.573761a1-d115-489e-bd08-36ec1da2b9d6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:36 devstack sudo[92357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116.573761a1-d115-489e-bd08-36ec1da2b9d6
Nov 05 09:31:36 devstack sudo[92357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:36 devstack sudo[92357]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116.573761a1-d115-489e-bd08-36ec1da2b9d6" returned: 0 in 0.310s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Lock "cinder-quobyte-573761a1-d115-489e-bd08-36ec1da2b9d6" released by "_delete_snapshot" :: held 2.258s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:31:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.430s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:31:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae575c9-bf66-4265-b156-1a8a36b1e10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcdf1900-e98d-4dc7-842a-9b97f2e15b42', 'volume_size': 1, 'source_volid': 'dd30a236-c2b2-47fa-b417-ddc4504fa116', 'source_volstatus': 'available'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa6acd6-ec26-4e22-bbd5-4903a9a97189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:36 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Volume volume-bcdf1900-e98d-4dc7-842a-9b97f2e15b42 (bcdf1900-e98d-4dc7-842a-9b97f2e15b42): created successfully
Nov 05 09:31:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa6acd6-ec26-4e22-bbd5-4903a9a97189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Flow 'volume_create_manager' (d206e479-8a2d-494d-831c-df55840b3817) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:31:36 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-e953bdd3-bb85-4546-9ec8-97d2007fc2a6 tempest-VolumesGetTest-1920286987 None] Created volume successfully.
Nov 05 09:31:38 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:31:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] Flow 'volume_create_manager' (b1c11b94-2ab2-48a7-9455-08954e593a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:31:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (484f77bc-baa8-4073-b08c-3f35bab9aafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (484f77bc-baa8-4073-b08c-3f35bab9aafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:31:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-475672886',display_name='tempest-VolumesGetTest-Volume-1176941034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d89e0e1-8e39-4727-9b60-6988fdab165c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='340e92f791744daa815d24fa5dba7d5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:31:38Z,use_quota=True,user_id='af6627fdb60841e4b282fee927d24970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79ce8b4-6fc4-41e2-a7d8-2c5a4a65f9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79ce8b4-6fc4-41e2-a7d8-2c5a4a65f9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b399f8-e910-4db3-9703-7a6033a31070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b399f8-e910-4db3-9703-7a6033a31070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d89e0e1-8e39-4727-9b60-6988fdab165c', 'volume_name': 'volume-6d89e0e1-8e39-4727-9b60-6988fdab165c', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0884b0c-1637-4423-ab9e-3ded21b80c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0884b0c-1637-4423-ab9e-3ded21b80c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (617f18da-aa50-405d-b7b8-78c69a1fbe2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:38 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] Volume 6d89e0e1-8e39-4727-9b60-6988fdab165c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d89e0e1-8e39-4727-9b60-6988fdab165c', 'volume_size': 1}
Nov 05 09:31:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:31:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:31:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:31:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-475672886',display_name='tempest-VolumesGetTest-Volume-1176941034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d89e0e1-8e39-4727-9b60-6988fdab165c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='340e92f791744daa815d24fa5dba7d5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:31:38Z,use_quota=True,user_id='af6627fdb60841e4b282fee927d24970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:31:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] Creating volume 6d89e0e1-8e39-4727-9b60-6988fdab165c {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:31:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:31:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:31:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:31:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:31:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:31:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:31:38 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:31:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6d89e0e1-8e39-4727-9b60-6988fdab165c 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:38 devstack sudo[92361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6d89e0e1-8e39-4727-9b60-6988fdab165c 1073741824
Nov 05 09:31:38 devstack sudo[92361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:38 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:31:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Flow 'volume_create_manager' (f4bb4f35-9243-4600-bad7-7e6bc8f1708f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:31:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd71b50-4f06-4bde-8c88-5b411cb4d774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd71b50-4f06-4bde-8c88-5b411cb4d774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-738357185',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=232dac1b-405a-49d0-b84c-fcc0c03e27ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07fd4d463deb4ea28b0d6471a8d43076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:31:39Z,use_quota=True,user_id='693ed10a6cab46f8bed92a922f4e691e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cb29196-21ea-4ac8-805e-bbf135483f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cb29196-21ea-4ac8-805e-bbf135483f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf17f4f7-1235-4352-a9e4-2bea7986fee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:38 devstack cinder-volume[86649]: DEBUG cinder.image.glance [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Creating Keystone auth plugin from conf {{(pid=86649) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 09:31:39 devstack sudo[92361]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6d89e0e1-8e39-4727-9b60-6988fdab165c 1073741824" returned: 0 in 0.629s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6d89e0e1-8e39-4727-9b60-6988fdab165c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:39 devstack sudo[92370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6d89e0e1-8e39-4727-9b60-6988fdab165c
Nov 05 09:31:39 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:39 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf17f4f7-1235-4352-a9e4-2bea7986fee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '232dac1b-405a-49d0-b84c-fcc0c03e27ad', 'volume_name': 'volume-232dac1b-405a-49d0-b84c-fcc0c03e27ad', 'volume_size': 1, 'image_id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ccc0fd9-02f4-4820-84b7-775604485a72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '407fc75c86be40efb1fcfded98df545b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'created_at': datetime.datetime(2026, 11, 5, 8, 20, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 8, 20, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ccc0fd9-02f4-4820-84b7-775604485a72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7841a6634800>}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956679c6-539c-4583-9f65-59621b511840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956679c6-539c-4583-9f65-59621b511840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e1e1355-b4b9-430a-9992-d767b946ee46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:39 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Volume 232dac1b-405a-49d0-b84c-fcc0c03e27ad: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-232dac1b-405a-49d0-b84c-fcc0c03e27ad', 'volume_size': 1, 'image_id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ccc0fd9-02f4-4820-84b7-775604485a72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '407fc75c86be40efb1fcfded98df545b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'created_at': datetime.datetime(2026, 11, 5, 8, 20, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 8, 20, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ccc0fd9-02f4-4820-84b7-775604485a72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7841a6634800>}
Nov 05 09:31:39 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Trying to clone 232dac1b-405a-49d0-b84c-fcc0c03e27ad from image 7ccc0fd9-02f4-4820-84b7-775604485a72 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7ccc0fd9-02f4-4820-84b7-775604485a72', 'metadata': {}}]). {{(pid=86649) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 09:31:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6d89e0e1-8e39-4727-9b60-6988fdab165c" returned: 0 in 0.376s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:31:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:31:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (617f18da-aa50-405d-b7b8-78c69a1fbe2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d89e0e1-8e39-4727-9b60-6988fdab165c', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4085ec7-fc52-4087-a358-ea9a073b5e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:39 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] Volume volume-6d89e0e1-8e39-4727-9b60-6988fdab165c (6d89e0e1-8e39-4727-9b60-6988fdab165c): created successfully
Nov 05 09:31:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4085ec7-fc52-4087-a358-ea9a073b5e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] Flow 'volume_create_manager' (b1c11b94-2ab2-48a7-9455-08954e593a33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:31:39 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-fe0c5bb6-67c0-4d53-83c0-6e446e412af9 tempest-VolumesGetTest-1920286987 None] Created volume successfully.
Nov 05 09:31:39 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_ezrv07yddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 09:31:39 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 09:31:39 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[388b5155-550c-4d85-bf61-9104b28f692e]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:31:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_ezrv07yddevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:40 devstack sudo[92395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_ezrv07yddevstack@QuobyteHD
Nov 05 09:31:40 devstack sudo[92395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:40 devstack sudo[92395]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_ezrv07yddevstack@QuobyteHD" returned: 0 in 0.426s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:40 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Temporary image 7ccc0fd9-02f4-4820-84b7-775604485a72 is fetched for user 693ed10a6cab46f8bed92a922f4e691e. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 09:31:40 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ae18a5-b425-49ba-ae11-6df8eac75c1a]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:31:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_ezrv07yddevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:40 devstack sudo[92406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_ezrv07yddevstack@QuobyteHD
Nov 05 09:31:40 devstack sudo[92406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bd10c3b4-8868-4591-9318-1be4eace6e4c tempest-VolumesGetTest-1920286987 None] Acquiring lock "cinder-6d89e0e1-8e39-4727-9b60-6988fdab165c-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:31:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bd10c3b4-8868-4591-9318-1be4eace6e4c tempest-VolumesGetTest-1920286987 None] Lock "cinder-6d89e0e1-8e39-4727-9b60-6988fdab165c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:31:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bd10c3b4-8868-4591-9318-1be4eace6e4c tempest-VolumesGetTest-1920286987 None] Acquiring lock "cinder-quobyte-6d89e0e1-8e39-4727-9b60-6988fdab165c" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:31:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bd10c3b4-8868-4591-9318-1be4eace6e4c tempest-VolumesGetTest-1920286987 None] Lock "cinder-quobyte-6d89e0e1-8e39-4727-9b60-6988fdab165c" acquired by "delete_volume" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:31:40 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fb1664-8fab-4393-80d5-becd290bc467]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:31:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bd10c3b4-8868-4591-9318-1be4eace6e4c tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6d89e0e1-8e39-4727-9b60-6988fdab165c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:40 devstack sudo[92406]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_ezrv07yddevstack@QuobyteHD" returned: 0 in 0.441s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:31:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:31:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-738357185',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=232dac1b-405a-49d0-b84c-fcc0c03e27ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07fd4d463deb4ea28b0d6471a8d43076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:31:39Z,use_quota=True,user_id='693ed10a6cab46f8bed92a922f4e691e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:31:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Creating volume 232dac1b-405a-49d0-b84c-fcc0c03e27ad {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:31:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:31:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:31:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:31:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:31:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:31:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:31:40 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:31:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-232dac1b-405a-49d0-b84c-fcc0c03e27ad 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:40 devstack sudo[92408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6d89e0e1-8e39-4727-9b60-6988fdab165c
Nov 05 09:31:40 devstack sudo[92408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:40 devstack sudo[92413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-232dac1b-405a-49d0-b84c-fcc0c03e27ad 1073741824
Nov 05 09:31:40 devstack sudo[92413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:41 devstack sudo[92408]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bd10c3b4-8868-4591-9318-1be4eace6e4c tempest-VolumesGetTest-1920286987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6d89e0e1-8e39-4727-9b60-6988fdab165c" returned: 0 in 0.414s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bd10c3b4-8868-4591-9318-1be4eace6e4c tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6d89e0e1-8e39-4727-9b60-6988fdab165c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:41 devstack sudo[92421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6d89e0e1-8e39-4727-9b60-6988fdab165c
Nov 05 09:31:41 devstack sudo[92421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:41 devstack sudo[92413]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-232dac1b-405a-49d0-b84c-fcc0c03e27ad 1073741824" returned: 0 in 0.517s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-232dac1b-405a-49d0-b84c-fcc0c03e27ad {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:41 devstack sudo[92425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-232dac1b-405a-49d0-b84c-fcc0c03e27ad
Nov 05 09:31:41 devstack sudo[92425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:41 devstack sudo[92421]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bd10c3b4-8868-4591-9318-1be4eace6e4c tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6d89e0e1-8e39-4727-9b60-6988fdab165c" returned: 0 in 0.321s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bd10c3b4-8868-4591-9318-1be4eace6e4c tempest-VolumesGetTest-1920286987 None] Lock "cinder-quobyte-6d89e0e1-8e39-4727-9b60-6988fdab165c" released by "delete_volume" :: held 0.803s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:31:41 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-bd10c3b4-8868-4591-9318-1be4eace6e4c tempest-VolumesGetTest-1920286987 None] Created reservations ['568848b8-598b-4698-bf39-1b3a6c4359b5', 'ce3c3656-e5bb-4899-aa2a-4f76b3ab1275', 'cbabed29-50a3-4ee0-a9c1-4b6863f74eb9', 'd5d33541-84c4-481e-ae37-b1c24ad9b6e2'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:31:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bd10c3b4-8868-4591-9318-1be4eace6e4c tempest-VolumesGetTest-1920286987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:31:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bd10c3b4-8868-4591-9318-1be4eace6e4c tempest-VolumesGetTest-1920286987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:31:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-bd10c3b4-8868-4591-9318-1be4eace6e4c tempest-VolumesGetTest-1920286987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:31:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-bd10c3b4-8868-4591-9318-1be4eace6e4c tempest-VolumesGetTest-1920286987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:31:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bd10c3b4-8868-4591-9318-1be4eace6e4c tempest-VolumesGetTest-1920286987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:31:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bd10c3b4-8868-4591-9318-1be4eace6e4c tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:41 devstack sudo[92427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:31:41 devstack sudo[92427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:41 devstack sudo[92425]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-232dac1b-405a-49d0-b84c-fcc0c03e27ad" returned: 0 in 0.357s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:31:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:31:41 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Attempting download of 7ccc0fd9-02f4-4820-84b7-775604485a72 ((None, [{'url': 'file:///opt/stack/data/glance/images/7ccc0fd9-02f4-4820-84b7-775604485a72', 'metadata': {}}])) to volume 232dac1b-405a-49d0-b84c-fcc0c03e27ad. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 09:31:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-88933682-233e-40ff-8768-303a1a922c14 tempest-VolumesGetTest-1920286987 None] Acquiring lock "cinder-bcdf1900-e98d-4dc7-842a-9b97f2e15b42-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:31:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-88933682-233e-40ff-8768-303a1a922c14 tempest-VolumesGetTest-1920286987 None] Lock "cinder-bcdf1900-e98d-4dc7-842a-9b97f2e15b42-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:31:42 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe9073f-7412-42c8-8644-8c7188ce9eaf]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:31:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_6gigjljq {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-88933682-233e-40ff-8768-303a1a922c14 tempest-VolumesGetTest-1920286987 None] Acquiring lock "cinder-quobyte-bcdf1900-e98d-4dc7-842a-9b97f2e15b42" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:31:42 devstack sudo[92427]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bd10c3b4-8868-4591-9318-1be4eace6e4c tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.417s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:42 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-bd10c3b4-8868-4591-9318-1be4eace6e4c tempest-VolumesGetTest-1920286987 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:31:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-88933682-233e-40ff-8768-303a1a922c14 tempest-VolumesGetTest-1920286987 None] Lock "cinder-quobyte-bcdf1900-e98d-4dc7-842a-9b97f2e15b42" acquired by "delete_volume" :: waited 0.044s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:31:42 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-bd10c3b4-8868-4591-9318-1be4eace6e4c tempest-VolumesGetTest-1920286987 None] Deleted volume successfully.
Nov 05 09:31:42 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[b403e9a7-8a61-42d7-b824-6e57e36369b0]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:31:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-88933682-233e-40ff-8768-303a1a922c14 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bcdf1900-e98d-4dc7-842a-9b97f2e15b42 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bd10c3b4-8868-4591-9318-1be4eace6e4c tempest-VolumesGetTest-1920286987 None] Lock "cinder-6d89e0e1-8e39-4727-9b60-6988fdab165c-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:31:42 devstack sudo[92431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_6gigjljq
Nov 05 09:31:42 devstack sudo[92431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:42 devstack sudo[92432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bcdf1900-e98d-4dc7-842a-9b97f2e15b42
Nov 05 09:31:42 devstack sudo[92432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:42 devstack sudo[92431]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_6gigjljq" returned: 0 in 0.388s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_6gigjljq {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:42 devstack sudo[92437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_6gigjljq
Nov 05 09:31:42 devstack sudo[92437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:42 devstack sudo[92432]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-88933682-233e-40ff-8768-303a1a922c14 tempest-VolumesGetTest-1920286987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bcdf1900-e98d-4dc7-842a-9b97f2e15b42" returned: 0 in 0.491s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-88933682-233e-40ff-8768-303a1a922c14 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bcdf1900-e98d-4dc7-842a-9b97f2e15b42 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:42 devstack sudo[92442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bcdf1900-e98d-4dc7-842a-9b97f2e15b42
Nov 05 09:31:42 devstack sudo[92442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:42 devstack sudo[92437]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_6gigjljq" returned: 1 in 0.452s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_6gigjljq' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 09:31:42 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e8e240-e411-4f8d-ab36-05be195c696e]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:31:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_ezrv07yddevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:42 devstack sudo[92442]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-88933682-233e-40ff-8768-303a1a922c14 tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bcdf1900-e98d-4dc7-842a-9b97f2e15b42" returned: 0 in 0.293s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-88933682-233e-40ff-8768-303a1a922c14 tempest-VolumesGetTest-1920286987 None] Lock "cinder-quobyte-bcdf1900-e98d-4dc7-842a-9b97f2e15b42" released by "delete_volume" :: held 0.849s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:31:43 devstack sudo[92446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_ezrv07yddevstack@QuobyteHD
Nov 05 09:31:43 devstack sudo[92446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:43 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-88933682-233e-40ff-8768-303a1a922c14 tempest-VolumesGetTest-1920286987 None] Created reservations ['efd9d5d8-5d8f-48ab-a627-366ecd1f1a09', 'd8ee8263-e53f-493f-a32a-0e9e922f4522', 'b12caf5b-6dd1-4f47-a7c9-9eb191e2c443', '9c555be7-8a23-4f46-89cd-02133a57bd90'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:31:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-88933682-233e-40ff-8768-303a1a922c14 tempest-VolumesGetTest-1920286987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:31:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-88933682-233e-40ff-8768-303a1a922c14 tempest-VolumesGetTest-1920286987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:31:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-88933682-233e-40ff-8768-303a1a922c14 tempest-VolumesGetTest-1920286987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:31:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-88933682-233e-40ff-8768-303a1a922c14 tempest-VolumesGetTest-1920286987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:31:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-88933682-233e-40ff-8768-303a1a922c14 tempest-VolumesGetTest-1920286987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:31:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-88933682-233e-40ff-8768-303a1a922c14 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:43 devstack sudo[92449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:31:43 devstack sudo[92449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:43 devstack sudo[92446]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_ezrv07yddevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:43 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] 7ccc0fd9-02f4-4820-84b7-775604485a72 was qcow2, converting to qcow2 {{(pid=86649) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 09:31:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_ezrv07yddevstack@QuobyteHD /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-232dac1b-405a-49d0-b84c-fcc0c03e27ad {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:43 devstack sudo[92455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_ezrv07yddevstack@QuobyteHD /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-232dac1b-405a-49d0-b84c-fcc0c03e27ad
Nov 05 09:31:43 devstack sudo[92455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:43 devstack sudo[92449]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-88933682-233e-40ff-8768-303a1a922c14 tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.274s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:43 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-88933682-233e-40ff-8768-303a1a922c14 tempest-VolumesGetTest-1920286987 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:31:43 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-88933682-233e-40ff-8768-303a1a922c14 tempest-VolumesGetTest-1920286987 None] Deleted volume successfully.
Nov 05 09:31:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-88933682-233e-40ff-8768-303a1a922c14 tempest-VolumesGetTest-1920286987 None] Lock "cinder-bcdf1900-e98d-4dc7-842a-9b97f2e15b42-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:31:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a993faaa-edda-4f2d-b104-2e6592df6577 tempest-VolumesGetTest-1920286987 None] Acquiring lock "cinder-dd30a236-c2b2-47fa-b417-ddc4504fa116-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:31:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a993faaa-edda-4f2d-b104-2e6592df6577 tempest-VolumesGetTest-1920286987 None] Lock "cinder-dd30a236-c2b2-47fa-b417-ddc4504fa116-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:31:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a993faaa-edda-4f2d-b104-2e6592df6577 tempest-VolumesGetTest-1920286987 None] Acquiring lock "cinder-quobyte-dd30a236-c2b2-47fa-b417-ddc4504fa116" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:31:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a993faaa-edda-4f2d-b104-2e6592df6577 tempest-VolumesGetTest-1920286987 None] Lock "cinder-quobyte-dd30a236-c2b2-47fa-b417-ddc4504fa116" acquired by "delete_volume" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:31:44 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b60dc8-bc23-40fd-89c7-2c24e5135ca0]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:31:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a993faaa-edda-4f2d-b104-2e6592df6577 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:44 devstack sudo[92470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116
Nov 05 09:31:44 devstack sudo[92470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:45 devstack sudo[92470]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a993faaa-edda-4f2d-b104-2e6592df6577 tempest-VolumesGetTest-1920286987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116" returned: 0 in 0.433s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a993faaa-edda-4f2d-b104-2e6592df6577 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:45 devstack sudo[92475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116
Nov 05 09:31:45 devstack sudo[92475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:45 devstack sudo[92475]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a993faaa-edda-4f2d-b104-2e6592df6577 tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dd30a236-c2b2-47fa-b417-ddc4504fa116" returned: 0 in 0.355s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a993faaa-edda-4f2d-b104-2e6592df6577 tempest-VolumesGetTest-1920286987 None] Lock "cinder-quobyte-dd30a236-c2b2-47fa-b417-ddc4504fa116" released by "delete_volume" :: held 0.883s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:31:45 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-a993faaa-edda-4f2d-b104-2e6592df6577 tempest-VolumesGetTest-1920286987 None] Created reservations ['9056d264-d9dc-419c-a1ef-c1852ce0d761', '032d72a8-55d4-4d97-9482-72056dd06126', 'dfb7ed86-9eb9-4fbe-b4a9-69b9ec79da28', '60e84858-986e-4ff8-91fe-c395a279fbcd'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:31:45 devstack sudo[92455]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_ezrv07yddevstack@QuobyteHD /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-232dac1b-405a-49d0-b84c-fcc0c03e27ad" returned: 0 in 2.249s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:45 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_ezrv07yddevstack@QuobyteHD, size 112.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-232dac1b-405a-49d0-b84c-fcc0c03e27ad {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 09:31:45 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Converted 112.00 MB image at 49.77 MB/s
Nov 05 09:31:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-232dac1b-405a-49d0-b84c-fcc0c03e27ad 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:45 devstack sudo[92478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-232dac1b-405a-49d0-b84c-fcc0c03e27ad 1G
Nov 05 09:31:45 devstack sudo[92478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a993faaa-edda-4f2d-b104-2e6592df6577 tempest-VolumesGetTest-1920286987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:31:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a993faaa-edda-4f2d-b104-2e6592df6577 tempest-VolumesGetTest-1920286987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:31:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a993faaa-edda-4f2d-b104-2e6592df6577 tempest-VolumesGetTest-1920286987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:31:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a993faaa-edda-4f2d-b104-2e6592df6577 tempest-VolumesGetTest-1920286987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:31:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a993faaa-edda-4f2d-b104-2e6592df6577 tempest-VolumesGetTest-1920286987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:31:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a993faaa-edda-4f2d-b104-2e6592df6577 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:45 devstack sudo[92480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:31:45 devstack sudo[92480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:45 devstack sudo[92480]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:45 devstack sudo[92478]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a993faaa-edda-4f2d-b104-2e6592df6577 tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.273s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:45 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-a993faaa-edda-4f2d-b104-2e6592df6577 tempest-VolumesGetTest-1920286987 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:31:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-232dac1b-405a-49d0-b84c-fcc0c03e27ad 1G" returned: 0 in 0.382s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:45 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Downloaded image 7ccc0fd9-02f4-4820-84b7-775604485a72 ((None, [{'url': 'file:///opt/stack/data/glance/images/7ccc0fd9-02f4-4820-84b7-775604485a72', 'metadata': {}}])) to volume 232dac1b-405a-49d0-b84c-fcc0c03e27ad successfully. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 09:31:45 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Temporary image 7ccc0fd9-02f4-4820-84b7-775604485a72 for user 693ed10a6cab46f8bed92a922f4e691e is deleted. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 09:31:45 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Marking volume 232dac1b-405a-49d0-b84c-fcc0c03e27ad as bootable. {{(pid=86649) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 09:31:45 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-a993faaa-edda-4f2d-b104-2e6592df6577 tempest-VolumesGetTest-1920286987 None] Deleted volume successfully.
Nov 05 09:31:45 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Copying metadata from image 7ccc0fd9-02f4-4820-84b7-775604485a72 to 232dac1b-405a-49d0-b84c-fcc0c03e27ad. {{(pid=86649) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 09:31:45 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Creating volume glance metadata for volume 232dac1b-405a-49d0-b84c-fcc0c03e27ad backed by image 7ccc0fd9-02f4-4820-84b7-775604485a72 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86649) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 09:31:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a993faaa-edda-4f2d-b104-2e6592df6577 tempest-VolumesGetTest-1920286987 None] Lock "cinder-dd30a236-c2b2-47fa-b417-ddc4504fa116-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:31:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e1e1355-b4b9-430a-9992-d767b946ee46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-232dac1b-405a-49d0-b84c-fcc0c03e27ad', 'volume_size': 1, 'image_id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ccc0fd9-02f4-4820-84b7-775604485a72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '407fc75c86be40efb1fcfded98df545b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'created_at': datetime.datetime(2026, 11, 5, 8, 20, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 8, 20, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ccc0fd9-02f4-4820-84b7-775604485a72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7841a6634800>}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abd376e2-3bf3-4fbf-9476-c43ced936c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:46 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Volume volume-232dac1b-405a-49d0-b84c-fcc0c03e27ad (232dac1b-405a-49d0-b84c-fcc0c03e27ad): created successfully
Nov 05 09:31:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abd376e2-3bf3-4fbf-9476-c43ced936c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Flow 'volume_create_manager' (f4bb4f35-9243-4600-bad7-7e6bc8f1708f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:31:46 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-11287540-fbbb-474a-90c7-aa2c78c260f7 tempest-ServerActionsTestOtherA-1591449576 None] Created volume successfully.
Nov 05 09:31:47 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:31:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Flow 'volume_create_manager' (e4f39d6d-c6d2-4c0f-be6f-0715c3f34a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:31:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33b20ff3-8d6a-4867-beeb-d51f0ec6f6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33b20ff3-8d6a-4867-beeb-d51f0ec6f6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1544043945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f6a175c-b5a1-428d-9d15-e8146554f972,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='340e92f791744daa815d24fa5dba7d5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:31:48Z,use_quota=True,user_id='af6627fdb60841e4b282fee927d24970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64f673d9-7be5-4c33-8b8d-aac33616be9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64f673d9-7be5-4c33-8b8d-aac33616be9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca20dc70-81a2-4fa3-bc3a-128460fbd773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:47 devstack cinder-volume[86649]: DEBUG cinder.image.glance [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Creating Keystone auth plugin from conf {{(pid=86649) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 09:31:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca20dc70-81a2-4fa3-bc3a-128460fbd773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6f6a175c-b5a1-428d-9d15-e8146554f972', 'volume_name': 'volume-6f6a175c-b5a1-428d-9d15-e8146554f972', 'volume_size': 1, 'image_id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ccc0fd9-02f4-4820-84b7-775604485a72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '407fc75c86be40efb1fcfded98df545b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'created_at': datetime.datetime(2026, 11, 5, 8, 20, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 8, 20, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ccc0fd9-02f4-4820-84b7-775604485a72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7841a655a690>}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1985d12-b28a-4704-8ddc-bf22ce47fd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1985d12-b28a-4704-8ddc-bf22ce47fd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f8f75c-dfa4-4de4-a351-2ae2aad90e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:48 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Volume 6f6a175c-b5a1-428d-9d15-e8146554f972: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6f6a175c-b5a1-428d-9d15-e8146554f972', 'volume_size': 1, 'image_id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ccc0fd9-02f4-4820-84b7-775604485a72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '407fc75c86be40efb1fcfded98df545b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'created_at': datetime.datetime(2026, 11, 5, 8, 20, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 8, 20, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ccc0fd9-02f4-4820-84b7-775604485a72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7841a655a690>}
Nov 05 09:31:48 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Trying to clone 6f6a175c-b5a1-428d-9d15-e8146554f972 from image 7ccc0fd9-02f4-4820-84b7-775604485a72 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7ccc0fd9-02f4-4820-84b7-775604485a72', 'metadata': {}}]). {{(pid=86649) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 09:31:48 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_nwmnuoo0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 09:31:48 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 09:31:48 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8332c26-4e13-46ef-967e-a8d89a782cb9]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:31:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_nwmnuoo0devstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:48 devstack sudo[92511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_nwmnuoo0devstack@QuobyteHD
Nov 05 09:31:48 devstack sudo[92511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:49 devstack sudo[92511]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_nwmnuoo0devstack@QuobyteHD" returned: 0 in 0.397s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:49 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Temporary image 7ccc0fd9-02f4-4820-84b7-775604485a72 is fetched for user af6627fdb60841e4b282fee927d24970. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 09:31:49 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8748d79-f555-4b69-8100-7db87b5d86dd]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:31:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_nwmnuoo0devstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:49 devstack sudo[92516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_nwmnuoo0devstack@QuobyteHD
Nov 05 09:31:49 devstack sudo[92516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:49 devstack sudo[92516]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_nwmnuoo0devstack@QuobyteHD" returned: 0 in 0.408s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:31:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:31:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1544043945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f6a175c-b5a1-428d-9d15-e8146554f972,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='340e92f791744daa815d24fa5dba7d5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:31:48Z,use_quota=True,user_id='af6627fdb60841e4b282fee927d24970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:31:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Creating volume 6f6a175c-b5a1-428d-9d15-e8146554f972 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:31:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:31:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:31:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:31:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:31:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:31:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:31:49 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:31:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6f6a175c-b5a1-428d-9d15-e8146554f972 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:49 devstack sudo[92529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6f6a175c-b5a1-428d-9d15-e8146554f972 1073741824
Nov 05 09:31:49 devstack sudo[92529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-e27dc696-9e0f-4375-8869-610873ae8313 req-2d1d5967-e29e-4cc7-a143-1f33cda2bd02 tempest-ServerActionsTestOtherA-1591449576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:31:50 devstack sudo[92529]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6f6a175c-b5a1-428d-9d15-e8146554f972 1073741824" returned: 0 in 0.525s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6f6a175c-b5a1-428d-9d15-e8146554f972 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:50 devstack sudo[92535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6f6a175c-b5a1-428d-9d15-e8146554f972
Nov 05 09:31:50 devstack sudo[92535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:50 devstack sudo[92535]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6f6a175c-b5a1-428d-9d15-e8146554f972" returned: 0 in 0.253s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:31:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:31:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-e27dc696-9e0f-4375-8869-610873ae8313 req-2d1d5967-e29e-4cc7-a143-1f33cda2bd02 tempest-ServerActionsTestOtherA-1591449576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.651s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:31:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-e27dc696-9e0f-4375-8869-610873ae8313 req-2d1d5967-e29e-4cc7-a143-1f33cda2bd02 tempest-ServerActionsTestOtherA-1591449576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:31:50 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Attempting download of 7ccc0fd9-02f4-4820-84b7-775604485a72 ((None, [{'url': 'file:///opt/stack/data/glance/images/7ccc0fd9-02f4-4820-84b7-775604485a72', 'metadata': {}}])) to volume 6f6a175c-b5a1-428d-9d15-e8146554f972. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 09:31:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-e27dc696-9e0f-4375-8869-610873ae8313 req-2d1d5967-e29e-4cc7-a143-1f33cda2bd02 tempest-ServerActionsTestOtherA-1591449576 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1', 'name': 'volume-232dac1b-405a-49d0-b84c-fcc0c03e27ad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f7091d9f-d630-4b52-a54d-77871f7ee181', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 09:31:50 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[4752632c-e127-4828-831d-bf1ca86cf583]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:31:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_at2aqd2x {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:50 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-e27dc696-9e0f-4375-8869-610873ae8313 req-2d1d5967-e29e-4cc7-a143-1f33cda2bd02 tempest-ServerActionsTestOtherA-1591449576 None] attachment_update completed successfully.
Nov 05 09:31:50 devstack sudo[92538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_at2aqd2x
Nov 05 09:31:50 devstack sudo[92538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:51 devstack sudo[92538]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_at2aqd2x" returned: 0 in 0.430s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_at2aqd2x {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:51 devstack sudo[92542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_at2aqd2x
Nov 05 09:31:51 devstack sudo[92542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:51 devstack sudo[92542]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_at2aqd2x" returned: 1 in 0.348s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_at2aqd2x' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 09:31:51 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[645dd09a-c9c7-43ca-a849-4823ea0de6ae]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:31:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_nwmnuoo0devstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:51 devstack sudo[92546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_nwmnuoo0devstack@QuobyteHD
Nov 05 09:31:51 devstack sudo[92546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:51 devstack sudo[92546]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_nwmnuoo0devstack@QuobyteHD" returned: 0 in 0.378s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:51 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] 7ccc0fd9-02f4-4820-84b7-775604485a72 was qcow2, converting to qcow2 {{(pid=86649) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 09:31:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_nwmnuoo0devstack@QuobyteHD /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6f6a175c-b5a1-428d-9d15-e8146554f972 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:51 devstack sudo[92552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_nwmnuoo0devstack@QuobyteHD /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6f6a175c-b5a1-428d-9d15-e8146554f972
Nov 05 09:31:51 devstack sudo[92552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:54 devstack sudo[92552]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_nwmnuoo0devstack@QuobyteHD /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6f6a175c-b5a1-428d-9d15-e8146554f972" returned: 0 in 2.619s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:54 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_nwmnuoo0devstack@QuobyteHD, size 112.00 MB, duration 2.62 sec, destination /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6f6a175c-b5a1-428d-9d15-e8146554f972 {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 09:31:54 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Converted 112.00 MB image at 42.75 MB/s
Nov 05 09:31:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6f6a175c-b5a1-428d-9d15-e8146554f972 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:54 devstack sudo[93020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6f6a175c-b5a1-428d-9d15-e8146554f972 1G
Nov 05 09:31:54 devstack sudo[93020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:54 devstack sudo[93020]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6f6a175c-b5a1-428d-9d15-e8146554f972 1G" returned: 0 in 0.403s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:54 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Downloaded image 7ccc0fd9-02f4-4820-84b7-775604485a72 ((None, [{'url': 'file:///opt/stack/data/glance/images/7ccc0fd9-02f4-4820-84b7-775604485a72', 'metadata': {}}])) to volume 6f6a175c-b5a1-428d-9d15-e8146554f972 successfully. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 09:31:54 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Temporary image 7ccc0fd9-02f4-4820-84b7-775604485a72 for user af6627fdb60841e4b282fee927d24970 is deleted. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 09:31:54 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Marking volume 6f6a175c-b5a1-428d-9d15-e8146554f972 as bootable. {{(pid=86649) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 09:31:54 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Copying metadata from image 7ccc0fd9-02f4-4820-84b7-775604485a72 to 6f6a175c-b5a1-428d-9d15-e8146554f972. {{(pid=86649) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 09:31:54 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Creating volume glance metadata for volume 6f6a175c-b5a1-428d-9d15-e8146554f972 backed by image 7ccc0fd9-02f4-4820-84b7-775604485a72 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86649) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 09:31:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f8f75c-dfa4-4de4-a351-2ae2aad90e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f6a175c-b5a1-428d-9d15-e8146554f972', 'volume_size': 1, 'image_id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ccc0fd9-02f4-4820-84b7-775604485a72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '407fc75c86be40efb1fcfded98df545b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'created_at': datetime.datetime(2026, 11, 5, 8, 20, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 8, 20, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ccc0fd9-02f4-4820-84b7-775604485a72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7841a655a690>}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c61a00-dc68-4346-a44f-b8d856cb2354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:55 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Volume volume-6f6a175c-b5a1-428d-9d15-e8146554f972 (6f6a175c-b5a1-428d-9d15-e8146554f972): created successfully
Nov 05 09:31:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c61a00-dc68-4346-a44f-b8d856cb2354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Flow 'volume_create_manager' (e4f39d6d-c6d2-4c0f-be6f-0715c3f34a23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:31:55 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-aa808dda-05fd-4edc-a30e-72bce6b60239 tempest-VolumesGetTest-1920286987 None] Created volume successfully.
Nov 05 09:31:56 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:31:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] Flow 'volume_create_manager' (18ada09b-4c4a-45ac-b5ba-74720bc29282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:31:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e8dc556-d7e5-4cc8-ba85-ac3d26c9be07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e8dc556-d7e5-4cc8-ba85-ac3d26c9be07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:31:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-590501555',display_name='tempest-VolumesGetTest-Volume-102601894',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9edc8f1c-a1c7-4fd2-8ca8-81465c4b9bf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='340e92f791744daa815d24fa5dba7d5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:31:56Z,use_quota=True,user_id='af6627fdb60841e4b282fee927d24970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95097d14-144f-4db5-889e-04e11706eb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95097d14-144f-4db5-889e-04e11706eb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ce5dbd8-dede-4cce-9be6-1a25d226a45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ce5dbd8-dede-4cce-9be6-1a25d226a45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9edc8f1c-a1c7-4fd2-8ca8-81465c4b9bf2', 'volume_name': 'volume-9edc8f1c-a1c7-4fd2-8ca8-81465c4b9bf2', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a31aa9a2-08bc-4db9-8bf0-e4059d38f7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a31aa9a2-08bc-4db9-8bf0-e4059d38f7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a61a42cf-cf8a-46c7-93d1-4a631390d041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:56 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] Volume 9edc8f1c-a1c7-4fd2-8ca8-81465c4b9bf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9edc8f1c-a1c7-4fd2-8ca8-81465c4b9bf2', 'volume_size': 1}
Nov 05 09:31:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:31:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:31:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:31:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-590501555',display_name='tempest-VolumesGetTest-Volume-102601894',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9edc8f1c-a1c7-4fd2-8ca8-81465c4b9bf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='340e92f791744daa815d24fa5dba7d5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:31:56Z,use_quota=True,user_id='af6627fdb60841e4b282fee927d24970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:31:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] Creating volume 9edc8f1c-a1c7-4fd2-8ca8-81465c4b9bf2 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:31:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:31:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:31:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:31:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:31:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:31:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:31:56 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:31:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9edc8f1c-a1c7-4fd2-8ca8-81465c4b9bf2 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:56 devstack sudo[93030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9edc8f1c-a1c7-4fd2-8ca8-81465c4b9bf2 1073741824
Nov 05 09:31:56 devstack sudo[93030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:57 devstack sudo[93030]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9edc8f1c-a1c7-4fd2-8ca8-81465c4b9bf2 1073741824" returned: 0 in 0.689s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9edc8f1c-a1c7-4fd2-8ca8-81465c4b9bf2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:57 devstack sudo[93040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9edc8f1c-a1c7-4fd2-8ca8-81465c4b9bf2
Nov 05 09:31:57 devstack sudo[93040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:31:57 devstack sudo[93040]: pam_unix(sudo:session): session closed for user root
Nov 05 09:31:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9edc8f1c-a1c7-4fd2-8ca8-81465c4b9bf2" returned: 0 in 0.423s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:31:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:31:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:31:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a61a42cf-cf8a-46c7-93d1-4a631390d041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9edc8f1c-a1c7-4fd2-8ca8-81465c4b9bf2', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b191e29b-7715-48cc-bf1c-d51cc5eb1926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:31:57 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] Volume volume-9edc8f1c-a1c7-4fd2-8ca8-81465c4b9bf2 (9edc8f1c-a1c7-4fd2-8ca8-81465c4b9bf2): created successfully
Nov 05 09:31:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b191e29b-7715-48cc-bf1c-d51cc5eb1926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:31:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] Flow 'volume_create_manager' (18ada09b-4c4a-45ac-b5ba-74720bc29282) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:31:57 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-7739e6f8-b4b2-4a28-9ba0-009e2ff5519f tempest-VolumesGetTest-1920286987 None] Created volume successfully.
Nov 05 09:31:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-988dc6b6-76d7-4362-aa3e-545d7fc94b9e tempest-VolumesGetTest-1920286987 None] Acquiring lock "cinder-9edc8f1c-a1c7-4fd2-8ca8-81465c4b9bf2-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:31:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-988dc6b6-76d7-4362-aa3e-545d7fc94b9e tempest-VolumesGetTest-1920286987 None] Lock "cinder-9edc8f1c-a1c7-4fd2-8ca8-81465c4b9bf2-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:31:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-988dc6b6-76d7-4362-aa3e-545d7fc94b9e tempest-VolumesGetTest-1920286987 None] Acquiring lock "cinder-quobyte-9edc8f1c-a1c7-4fd2-8ca8-81465c4b9bf2" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:31:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-988dc6b6-76d7-4362-aa3e-545d7fc94b9e tempest-VolumesGetTest-1920286987 None] Lock "cinder-quobyte-9edc8f1c-a1c7-4fd2-8ca8-81465c4b9bf2" acquired by "delete_volume" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:31:59 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[2517dfd9-db5b-4e51-a836-dbd7bcd5f5af]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:31:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-988dc6b6-76d7-4362-aa3e-545d7fc94b9e tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9edc8f1c-a1c7-4fd2-8ca8-81465c4b9bf2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:31:59 devstack sudo[93077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9edc8f1c-a1c7-4fd2-8ca8-81465c4b9bf2
Nov 05 09:31:59 devstack sudo[93077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:32:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:32:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 28 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:32:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>, <Thread(tpool_thread_0, started daemon 132223357408960)>, <Thread(tpool_thread_1, started daemon 132223349016256)>, <Thread(tpool_thread_2, started daemon 132223340623552)>, <Thread(tpool_thread_3, started daemon 132223332230848)>, <Thread(tpool_thread_4, started daemon 132223323838144)>, <Thread(tpool_thread_5, started daemon 132223315445440)>, <Thread(tpool_thread_6, started daemon 132223307052736)>, <Thread(tpool_thread_7, started daemon 132223298660032)>, <Thread(tpool_thread_8, started daemon 132223290250944)>, <Thread(tpool_thread_9, started daemon 132223281841856)>, <Thread(tpool_thread_10, started daemon 132223273432768)>, <Thread(tpool_thread_11, started daemon 132223265023680)>, <Thread(tpool_thread_12, started daemon 132223256614592)>, <Thread(tpool_thread_13, started daemon 132223248205504)>, <Thread(tpool_thread_14, started daemon 132223239796416)>, <Thread(tpool_thread_15, started daemon 132223231387328)>, <Thread(tpool_thread_16, started daemon 132223222978240)>, <Thread(tpool_thread_17, started daemon 132223214569152)>, <Thread(tpool_thread_18, started daemon 132223206160064)>, <Thread(tpool_thread_19, started daemon 132223197750976)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:32:00 devstack sudo[93077]: pam_unix(sudo:session): session closed for user root
Nov 05 09:32:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-988dc6b6-76d7-4362-aa3e-545d7fc94b9e tempest-VolumesGetTest-1920286987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9edc8f1c-a1c7-4fd2-8ca8-81465c4b9bf2" returned: 0 in 0.737s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:32:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-988dc6b6-76d7-4362-aa3e-545d7fc94b9e tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9edc8f1c-a1c7-4fd2-8ca8-81465c4b9bf2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:32:00 devstack sudo[93082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9edc8f1c-a1c7-4fd2-8ca8-81465c4b9bf2
Nov 05 09:32:00 devstack sudo[93082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:32:00 devstack sudo[93082]: pam_unix(sudo:session): session closed for user root
Nov 05 09:32:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-988dc6b6-76d7-4362-aa3e-545d7fc94b9e tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9edc8f1c-a1c7-4fd2-8ca8-81465c4b9bf2" returned: 0 in 0.641s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:32:00 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-988dc6b6-76d7-4362-aa3e-545d7fc94b9e tempest-VolumesGetTest-1920286987 None] Lock "cinder-quobyte-9edc8f1c-a1c7-4fd2-8ca8-81465c4b9bf2" released by "delete_volume" :: held 1.507s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:32:01 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-988dc6b6-76d7-4362-aa3e-545d7fc94b9e tempest-VolumesGetTest-1920286987 None] Created reservations ['3cddbe3b-0e3e-461f-a2d8-bf0136e827e5', '2f670521-bc21-4f93-8b26-157650cddb28', 'a3136cb3-1f17-4733-915e-4b0b8dd265b4', '6866459d-b6dc-482a-9a61-39f455ca61c4'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:32:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-988dc6b6-76d7-4362-aa3e-545d7fc94b9e tempest-VolumesGetTest-1920286987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:32:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-988dc6b6-76d7-4362-aa3e-545d7fc94b9e tempest-VolumesGetTest-1920286987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:32:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-988dc6b6-76d7-4362-aa3e-545d7fc94b9e tempest-VolumesGetTest-1920286987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:32:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-988dc6b6-76d7-4362-aa3e-545d7fc94b9e tempest-VolumesGetTest-1920286987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:32:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-988dc6b6-76d7-4362-aa3e-545d7fc94b9e tempest-VolumesGetTest-1920286987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:32:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-988dc6b6-76d7-4362-aa3e-545d7fc94b9e tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:32:01 devstack sudo[93087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:32:01 devstack sudo[93087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:32:01 devstack sudo[93087]: pam_unix(sudo:session): session closed for user root
Nov 05 09:32:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-988dc6b6-76d7-4362-aa3e-545d7fc94b9e tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.583s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:32:01 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-988dc6b6-76d7-4362-aa3e-545d7fc94b9e tempest-VolumesGetTest-1920286987 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:32:01 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-988dc6b6-76d7-4362-aa3e-545d7fc94b9e tempest-VolumesGetTest-1920286987 None] Deleted volume successfully.
Nov 05 09:32:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-988dc6b6-76d7-4362-aa3e-545d7fc94b9e tempest-VolumesGetTest-1920286987 None] Lock "cinder-9edc8f1c-a1c7-4fd2-8ca8-81465c4b9bf2-delete_volume" released by "delete_volume" :: held 2.520s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:32:02 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:32:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] Flow 'volume_create_manager' (de241153-63b5-407f-bb66-80fd6c0d5175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:32:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40439dc8-b3b9-4e4b-8c4b-711f2ade20c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:32:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e7f03593-3b63-41d8-bf5c-43d909636b4d tempest-VolumesGetTest-1920286987 None] Acquiring lock "cinder-6f6a175c-b5a1-428d-9d15-e8146554f972-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:32:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40439dc8-b3b9-4e4b-8c4b-711f2ade20c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-290281919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2fc482b-0c7b-420c-8ac2-13b19738006b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9299aca46e4a58b81b80790ba6a4d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:32:02Z,use_quota=True,user_id='59015f6858dd499b93837a2aef5a5b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:32:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9cd9c2b-a654-480c-a7b4-05dda1e13916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:32:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9cd9c2b-a654-480c-a7b4-05dda1e13916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:32:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d4246e-0f67-4812-97c6-66c34c4834a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:32:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d4246e-0f67-4812-97c6-66c34c4834a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2fc482b-0c7b-420c-8ac2-13b19738006b', 'volume_name': 'volume-e2fc482b-0c7b-420c-8ac2-13b19738006b', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:32:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (327036c0-3048-42d7-81ea-210ce1c78161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:32:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (327036c0-3048-42d7-81ea-210ce1c78161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:32:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6193dfc3-b7ec-4e72-a618-f3c01ef11a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:32:02 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] Volume e2fc482b-0c7b-420c-8ac2-13b19738006b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2fc482b-0c7b-420c-8ac2-13b19738006b', 'volume_size': 1}
Nov 05 09:32:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:32:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:32:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-290281919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2fc482b-0c7b-420c-8ac2-13b19738006b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9299aca46e4a58b81b80790ba6a4d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:32:02Z,use_quota=True,user_id='59015f6858dd499b93837a2aef5a5b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:32:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] Creating volume e2fc482b-0c7b-420c-8ac2-13b19738006b {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:32:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:32:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:32:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:32:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:32:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:32:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:32:02 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:32:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e2fc482b-0c7b-420c-8ac2-13b19738006b 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:32:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e7f03593-3b63-41d8-bf5c-43d909636b4d tempest-VolumesGetTest-1920286987 None] Lock "cinder-6f6a175c-b5a1-428d-9d15-e8146554f972-delete_volume" acquired by "delete_volume" :: waited 0.168s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:32:02 devstack sudo[93092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e2fc482b-0c7b-420c-8ac2-13b19738006b 1073741824
Nov 05 09:32:02 devstack sudo[93092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:32:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e7f03593-3b63-41d8-bf5c-43d909636b4d tempest-VolumesGetTest-1920286987 None] Acquiring lock "cinder-quobyte-6f6a175c-b5a1-428d-9d15-e8146554f972" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:32:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e7f03593-3b63-41d8-bf5c-43d909636b4d tempest-VolumesGetTest-1920286987 None] Lock "cinder-quobyte-6f6a175c-b5a1-428d-9d15-e8146554f972" acquired by "delete_volume" :: waited 0.039s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:32:02 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abd1f83-5f49-4a8c-8523-df250e9ea4db]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:32:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e7f03593-3b63-41d8-bf5c-43d909636b4d tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6f6a175c-b5a1-428d-9d15-e8146554f972 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:32:02 devstack sudo[93095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6f6a175c-b5a1-428d-9d15-e8146554f972
Nov 05 09:32:02 devstack sudo[93095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:32:02 devstack sudo[93092]: pam_unix(sudo:session): session closed for user root
Nov 05 09:32:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e2fc482b-0c7b-420c-8ac2-13b19738006b 1073741824" returned: 0 in 0.674s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:32:02 devstack sudo[93095]: pam_unix(sudo:session): session closed for user root
Nov 05 09:32:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e7f03593-3b63-41d8-bf5c-43d909636b4d tempest-VolumesGetTest-1920286987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6f6a175c-b5a1-428d-9d15-e8146554f972" returned: 0 in 0.527s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:32:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e7f03593-3b63-41d8-bf5c-43d909636b4d tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6f6a175c-b5a1-428d-9d15-e8146554f972 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:32:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e2fc482b-0c7b-420c-8ac2-13b19738006b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:32:03 devstack sudo[93105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6f6a175c-b5a1-428d-9d15-e8146554f972
Nov 05 09:32:03 devstack sudo[93105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:32:03 devstack sudo[93106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e2fc482b-0c7b-420c-8ac2-13b19738006b
Nov 05 09:32:03 devstack sudo[93106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:32:03 devstack sudo[93105]: pam_unix(sudo:session): session closed for user root
Nov 05 09:32:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e7f03593-3b63-41d8-bf5c-43d909636b4d tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6f6a175c-b5a1-428d-9d15-e8146554f972" returned: 0 in 0.442s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:32:03 devstack sudo[93106]: pam_unix(sudo:session): session closed for user root
Nov 05 09:32:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e2fc482b-0c7b-420c-8ac2-13b19738006b" returned: 0 in 0.453s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:32:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:32:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:32:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e7f03593-3b63-41d8-bf5c-43d909636b4d tempest-VolumesGetTest-1920286987 None] Lock "cinder-quobyte-6f6a175c-b5a1-428d-9d15-e8146554f972" released by "delete_volume" :: held 1.082s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:32:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6193dfc3-b7ec-4e72-a618-f3c01ef11a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2fc482b-0c7b-420c-8ac2-13b19738006b', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:32:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f03ef8b-12bf-4f51-ba7b-f0e9d7add27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:32:03 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] Volume volume-e2fc482b-0c7b-420c-8ac2-13b19738006b (e2fc482b-0c7b-420c-8ac2-13b19738006b): created successfully
Nov 05 09:32:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f03ef8b-12bf-4f51-ba7b-f0e9d7add27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:32:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] Flow 'volume_create_manager' (de241153-63b5-407f-bb66-80fd6c0d5175) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:32:03 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-1fa3a503-b5de-4689-ac56-e60bff9171ec tempest-AttachVolumeNegativeTest-1674973412 None] Created volume successfully.
Nov 05 09:32:03 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-e7f03593-3b63-41d8-bf5c-43d909636b4d tempest-VolumesGetTest-1920286987 None] Created reservations ['b152c89e-45ea-4117-9975-c7350160fa8e', 'e59e07c2-1830-4b54-b627-a98308f5f186', 'cdccecd9-e552-4ed4-b4b0-217285e89d97', '90346fa5-b72e-4906-ac0b-b6886de44cc6'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:32:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e7f03593-3b63-41d8-bf5c-43d909636b4d tempest-VolumesGetTest-1920286987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:32:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e7f03593-3b63-41d8-bf5c-43d909636b4d tempest-VolumesGetTest-1920286987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:32:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e7f03593-3b63-41d8-bf5c-43d909636b4d tempest-VolumesGetTest-1920286987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:32:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e7f03593-3b63-41d8-bf5c-43d909636b4d tempest-VolumesGetTest-1920286987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:32:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e7f03593-3b63-41d8-bf5c-43d909636b4d tempest-VolumesGetTest-1920286987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:32:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e7f03593-3b63-41d8-bf5c-43d909636b4d tempest-VolumesGetTest-1920286987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:32:03 devstack sudo[93112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:32:03 devstack sudo[93112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:32:03 devstack sudo[93112]: pam_unix(sudo:session): session closed for user root
Nov 05 09:32:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e7f03593-3b63-41d8-bf5c-43d909636b4d tempest-VolumesGetTest-1920286987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.338s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:32:03 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-e7f03593-3b63-41d8-bf5c-43d909636b4d tempest-VolumesGetTest-1920286987 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:32:03 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-e7f03593-3b63-41d8-bf5c-43d909636b4d tempest-VolumesGetTest-1920286987 None] Deleted volume successfully.
Nov 05 09:32:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e7f03593-3b63-41d8-bf5c-43d909636b4d tempest-VolumesGetTest-1920286987 None] Lock "cinder-6f6a175c-b5a1-428d-9d15-e8146554f972-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:32:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-78a7d837-e789-4fef-b5a8-bb3ef5ea8abc req-949a2196-49c7-4e83-a363-b51fe70db4fd tempest-AttachVolumeNegativeTest-1674973412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:32:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-78a7d837-e789-4fef-b5a8-bb3ef5ea8abc req-949a2196-49c7-4e83-a363-b51fe70db4fd tempest-AttachVolumeNegativeTest-1674973412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:32:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-78a7d837-e789-4fef-b5a8-bb3ef5ea8abc req-949a2196-49c7-4e83-a363-b51fe70db4fd tempest-AttachVolumeNegativeTest-1674973412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:32:05 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-433cdcaa-57fe-4304-b1b0-09b05826e427 req-ca69f744-d4be-4ed9-9706-3d12a8487d97 tempest-ServerActionsTestOtherA-1591449576 None] Terminate volume connection completed successfully.
Nov 05 09:32:05 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-433cdcaa-57fe-4304-b1b0-09b05826e427 req-ca69f744-d4be-4ed9-9706-3d12a8487d97 tempest-ServerActionsTestOtherA-1591449576 None] Deleting attachment f7091d9f-d630-4b52-a54d-77871f7ee181. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 09:32:05 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-78a7d837-e789-4fef-b5a8-bb3ef5ea8abc req-949a2196-49c7-4e83-a363-b51fe70db4fd tempest-AttachVolumeNegativeTest-1674973412 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1', 'name': 'volume-e2fc482b-0c7b-420c-8ac2-13b19738006b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '836b6283-f634-4045-b062-2a14846a8489', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 09:32:05 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-78a7d837-e789-4fef-b5a8-bb3ef5ea8abc req-949a2196-49c7-4e83-a363-b51fe70db4fd tempest-AttachVolumeNegativeTest-1674973412 None] attachment_update completed successfully.
Nov 05 09:32:09 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:32:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] Flow 'volume_create_manager' (6ba3c9f4-4126-4964-8546-e719dd04dc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:32:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (657963e8-48b6-4c29-af5c-4360dad5e95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:32:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (657963e8-48b6-4c29-af5c-4360dad5e95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2086622729',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d223e593-4286-4465-8168-8cadd590293f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcda37a3f257465795afecae5d00d08e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:32:09Z,use_quota=True,user_id='e34356fc24584fa8baeec2a43060170d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:32:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f98301-9894-4fbc-930b-7d846623bb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:32:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f98301-9894-4fbc-930b-7d846623bb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:32:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a65b32c5-5407-48e1-afa7-ea4d2bd31104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:32:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a65b32c5-5407-48e1-afa7-ea4d2bd31104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd223e593-4286-4465-8168-8cadd590293f', 'volume_name': 'volume-d223e593-4286-4465-8168-8cadd590293f', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:32:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f37235-02b5-4fb6-97ae-bb78bccb03f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:32:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f37235-02b5-4fb6-97ae-bb78bccb03f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:32:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4872093-4aec-491c-8279-4d305c9fee84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:32:09 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] Volume d223e593-4286-4465-8168-8cadd590293f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d223e593-4286-4465-8168-8cadd590293f', 'volume_size': 1}
Nov 05 09:32:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:32:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:32:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2086622729',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d223e593-4286-4465-8168-8cadd590293f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcda37a3f257465795afecae5d00d08e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:32:09Z,use_quota=True,user_id='e34356fc24584fa8baeec2a43060170d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:32:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] Creating volume d223e593-4286-4465-8168-8cadd590293f {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:32:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:32:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:32:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:32:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:32:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:32:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:32:09 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:32:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d223e593-4286-4465-8168-8cadd590293f 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:32:09 devstack sudo[93595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d223e593-4286-4465-8168-8cadd590293f 1073741824
Nov 05 09:32:09 devstack sudo[93595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:32:10 devstack sudo[93595]: pam_unix(sudo:session): session closed for user root
Nov 05 09:32:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d223e593-4286-4465-8168-8cadd590293f 1073741824" returned: 0 in 0.584s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:32:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d223e593-4286-4465-8168-8cadd590293f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:32:10 devstack sudo[93609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d223e593-4286-4465-8168-8cadd590293f
Nov 05 09:32:10 devstack sudo[93609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:32:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-433cdcaa-57fe-4304-b1b0-09b05826e427 req-2ce22c6b-dcff-40a6-9a3c-bf191494768f tempest-ServerActionsTestOtherA-1591449576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:32:10 devstack sudo[93609]: pam_unix(sudo:session): session closed for user root
Nov 05 09:32:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d223e593-4286-4465-8168-8cadd590293f" returned: 0 in 0.285s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:32:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:32:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:32:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-433cdcaa-57fe-4304-b1b0-09b05826e427 req-2ce22c6b-dcff-40a6-9a3c-bf191494768f tempest-ServerActionsTestOtherA-1591449576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.188s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:32:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4872093-4aec-491c-8279-4d305c9fee84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d223e593-4286-4465-8168-8cadd590293f', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:32:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed51caf-7dbb-438c-968b-3c9c66ebcc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:32:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-433cdcaa-57fe-4304-b1b0-09b05826e427 req-2ce22c6b-dcff-40a6-9a3c-bf191494768f tempest-ServerActionsTestOtherA-1591449576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:32:10 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] Volume volume-d223e593-4286-4465-8168-8cadd590293f (d223e593-4286-4465-8168-8cadd590293f): created successfully
Nov 05 09:32:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed51caf-7dbb-438c-968b-3c9c66ebcc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:32:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] Flow 'volume_create_manager' (6ba3c9f4-4126-4964-8546-e719dd04dc62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:32:10 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-0ecf4ff0-0ace-4a58-92e1-7aeab12d9d06 tempest-VolumesNegativeTest-1309039431 None] Created volume successfully.
Nov 05 09:32:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-433cdcaa-57fe-4304-b1b0-09b05826e427 req-2ce22c6b-dcff-40a6-9a3c-bf191494768f tempest-ServerActionsTestOtherA-1591449576 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1', 'name': 'volume-232dac1b-405a-49d0-b84c-fcc0c03e27ad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03e3cd00-34f9-4255-b075-4064b75a3ddf', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 09:32:10 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-433cdcaa-57fe-4304-b1b0-09b05826e427 req-2ce22c6b-dcff-40a6-9a3c-bf191494768f tempest-ServerActionsTestOtherA-1591449576 None] attachment_update completed successfully.
Nov 05 09:32:20 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=75,cinder:SELECT=68,cinder:DELETE=8,cinder:INSERT=23 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:32:20 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:INSERT=35,cinder:UPDATE=85,cinder:SELECT=93,cinder:DELETE=4 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:32:47 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-74ac59e7-a806-4059-a44e-0571ff788d26 req-ff356c79-d898-4f42-9e14-b26a8b19174a tempest-ServerActionsTestOtherA-1591449576 None] Terminate volume connection completed successfully.
Nov 05 09:32:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-74ac59e7-a806-4059-a44e-0571ff788d26 req-ff356c79-d898-4f42-9e14-b26a8b19174a tempest-ServerActionsTestOtherA-1591449576 None] Deleting attachment 03e3cd00-34f9-4255-b075-4064b75a3ddf. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 09:32:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-74ac59e7-a806-4059-a44e-0571ff788d26 req-45de2d9a-101c-49e7-8afd-6e2d2c963442 tempest-ServerActionsTestOtherA-1591449576 None] Acquiring lock "cinder-232dac1b-405a-49d0-b84c-fcc0c03e27ad-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:32:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-74ac59e7-a806-4059-a44e-0571ff788d26 req-45de2d9a-101c-49e7-8afd-6e2d2c963442 tempest-ServerActionsTestOtherA-1591449576 None] Lock "cinder-232dac1b-405a-49d0-b84c-fcc0c03e27ad-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:32:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-74ac59e7-a806-4059-a44e-0571ff788d26 req-45de2d9a-101c-49e7-8afd-6e2d2c963442 tempest-ServerActionsTestOtherA-1591449576 None] Acquiring lock "cinder-quobyte-232dac1b-405a-49d0-b84c-fcc0c03e27ad" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:32:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-74ac59e7-a806-4059-a44e-0571ff788d26 req-45de2d9a-101c-49e7-8afd-6e2d2c963442 tempest-ServerActionsTestOtherA-1591449576 None] Lock "cinder-quobyte-232dac1b-405a-49d0-b84c-fcc0c03e27ad" acquired by "delete_volume" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:32:47 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e7386f-404e-47bf-b1c6-1811516ef1bb]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:32:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-74ac59e7-a806-4059-a44e-0571ff788d26 req-45de2d9a-101c-49e7-8afd-6e2d2c963442 tempest-ServerActionsTestOtherA-1591449576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-232dac1b-405a-49d0-b84c-fcc0c03e27ad {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:32:47 devstack sudo[93929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-232dac1b-405a-49d0-b84c-fcc0c03e27ad
Nov 05 09:32:47 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:32:48 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root
Nov 05 09:32:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-74ac59e7-a806-4059-a44e-0571ff788d26 req-45de2d9a-101c-49e7-8afd-6e2d2c963442 tempest-ServerActionsTestOtherA-1591449576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-232dac1b-405a-49d0-b84c-fcc0c03e27ad" returned: 0 in 0.428s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:32:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-74ac59e7-a806-4059-a44e-0571ff788d26 req-45de2d9a-101c-49e7-8afd-6e2d2c963442 tempest-ServerActionsTestOtherA-1591449576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-232dac1b-405a-49d0-b84c-fcc0c03e27ad {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:32:48 devstack sudo[93935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-232dac1b-405a-49d0-b84c-fcc0c03e27ad
Nov 05 09:32:48 devstack sudo[93935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:32:48 devstack sudo[93935]: pam_unix(sudo:session): session closed for user root
Nov 05 09:32:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-74ac59e7-a806-4059-a44e-0571ff788d26 req-45de2d9a-101c-49e7-8afd-6e2d2c963442 tempest-ServerActionsTestOtherA-1591449576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-232dac1b-405a-49d0-b84c-fcc0c03e27ad" returned: 0 in 0.259s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:32:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-74ac59e7-a806-4059-a44e-0571ff788d26 req-45de2d9a-101c-49e7-8afd-6e2d2c963442 tempest-ServerActionsTestOtherA-1591449576 None] Lock "cinder-quobyte-232dac1b-405a-49d0-b84c-fcc0c03e27ad" released by "delete_volume" :: held 0.758s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:32:48 devstack cinder-volume[86649]: DEBUG cinder.quota [req-74ac59e7-a806-4059-a44e-0571ff788d26 req-45de2d9a-101c-49e7-8afd-6e2d2c963442 tempest-ServerActionsTestOtherA-1591449576 None] Created reservations ['0e34665a-71d5-420f-8f8d-29d775d7f29c', '093d9165-7d9c-479c-8309-2e6ee3cb0bf3', '06f7e235-9b5a-4560-8f3d-8bc1c7cbddc8', 'b2d2d764-eda9-49f7-a35a-cb2c00ee6552'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:32:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-74ac59e7-a806-4059-a44e-0571ff788d26 req-45de2d9a-101c-49e7-8afd-6e2d2c963442 tempest-ServerActionsTestOtherA-1591449576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:32:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-74ac59e7-a806-4059-a44e-0571ff788d26 req-45de2d9a-101c-49e7-8afd-6e2d2c963442 tempest-ServerActionsTestOtherA-1591449576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:32:48 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [req-74ac59e7-a806-4059-a44e-0571ff788d26 req-45de2d9a-101c-49e7-8afd-6e2d2c963442 tempest-ServerActionsTestOtherA-1591449576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:32:48 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [req-74ac59e7-a806-4059-a44e-0571ff788d26 req-45de2d9a-101c-49e7-8afd-6e2d2c963442 tempest-ServerActionsTestOtherA-1591449576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:32:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-74ac59e7-a806-4059-a44e-0571ff788d26 req-45de2d9a-101c-49e7-8afd-6e2d2c963442 tempest-ServerActionsTestOtherA-1591449576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:32:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-74ac59e7-a806-4059-a44e-0571ff788d26 req-45de2d9a-101c-49e7-8afd-6e2d2c963442 tempest-ServerActionsTestOtherA-1591449576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:32:48 devstack sudo[93938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:32:48 devstack sudo[93938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:32:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6a2372ea-6fda-4949-8500-063319dcd004 tempest-ServerActionsTestOtherA-1591449576 None] Acquiring lock "cinder-60ab7b69-ae03-4977-bb12-2b5cdfc47e91-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:32:48 devstack sudo[93938]: pam_unix(sudo:session): session closed for user root
Nov 05 09:32:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6a2372ea-6fda-4949-8500-063319dcd004 tempest-ServerActionsTestOtherA-1591449576 None] Lock "cinder-60ab7b69-ae03-4977-bb12-2b5cdfc47e91-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:32:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-74ac59e7-a806-4059-a44e-0571ff788d26 req-45de2d9a-101c-49e7-8afd-6e2d2c963442 tempest-ServerActionsTestOtherA-1591449576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.305s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:32:48 devstack cinder-volume[86649]: DEBUG cinder.manager [req-74ac59e7-a806-4059-a44e-0571ff788d26 req-45de2d9a-101c-49e7-8afd-6e2d2c963442 tempest-ServerActionsTestOtherA-1591449576 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:32:48 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-74ac59e7-a806-4059-a44e-0571ff788d26 req-45de2d9a-101c-49e7-8afd-6e2d2c963442 tempest-ServerActionsTestOtherA-1591449576 None] Deleted volume successfully.
Nov 05 09:32:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-74ac59e7-a806-4059-a44e-0571ff788d26 req-45de2d9a-101c-49e7-8afd-6e2d2c963442 tempest-ServerActionsTestOtherA-1591449576 None] Lock "cinder-232dac1b-405a-49d0-b84c-fcc0c03e27ad-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:32:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6a2372ea-6fda-4949-8500-063319dcd004 tempest-ServerActionsTestOtherA-1591449576 None] Acquiring lock "cinder-quobyte-60ab7b69-ae03-4977-bb12-2b5cdfc47e91" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:32:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6a2372ea-6fda-4949-8500-063319dcd004 tempest-ServerActionsTestOtherA-1591449576 None] Lock "cinder-quobyte-60ab7b69-ae03-4977-bb12-2b5cdfc47e91" acquired by "delete_volume" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:32:48 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82f254d-c4df-4770-93ec-845e7a17435f]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:32:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a2372ea-6fda-4949-8500-063319dcd004 tempest-ServerActionsTestOtherA-1591449576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-60ab7b69-ae03-4977-bb12-2b5cdfc47e91 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:32:48 devstack sudo[93942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-60ab7b69-ae03-4977-bb12-2b5cdfc47e91
Nov 05 09:32:48 devstack sudo[93942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:32:49 devstack sudo[93942]: pam_unix(sudo:session): session closed for user root
Nov 05 09:32:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a2372ea-6fda-4949-8500-063319dcd004 tempest-ServerActionsTestOtherA-1591449576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-60ab7b69-ae03-4977-bb12-2b5cdfc47e91" returned: 0 in 0.374s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:32:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a2372ea-6fda-4949-8500-063319dcd004 tempest-ServerActionsTestOtherA-1591449576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-60ab7b69-ae03-4977-bb12-2b5cdfc47e91 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:32:49 devstack sudo[93947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-60ab7b69-ae03-4977-bb12-2b5cdfc47e91
Nov 05 09:32:49 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:32:49 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root
Nov 05 09:32:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a2372ea-6fda-4949-8500-063319dcd004 tempest-ServerActionsTestOtherA-1591449576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-60ab7b69-ae03-4977-bb12-2b5cdfc47e91" returned: 0 in 0.255s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:32:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6a2372ea-6fda-4949-8500-063319dcd004 tempest-ServerActionsTestOtherA-1591449576 None] Lock "cinder-quobyte-60ab7b69-ae03-4977-bb12-2b5cdfc47e91" released by "delete_volume" :: held 0.675s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:32:49 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-6a2372ea-6fda-4949-8500-063319dcd004 tempest-ServerActionsTestOtherA-1591449576 None] Created reservations ['97548345-bc49-44fe-b6db-acdaa02d5d64', 'b871870c-3509-4d0c-b7b9-8836bca07f80', 'b5ad0144-081c-4fa2-aa49-e53466dfd64f', '94258e5e-cb7b-40f6-a473-56ff137233af'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:32:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6a2372ea-6fda-4949-8500-063319dcd004 tempest-ServerActionsTestOtherA-1591449576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:32:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6a2372ea-6fda-4949-8500-063319dcd004 tempest-ServerActionsTestOtherA-1591449576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:32:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6a2372ea-6fda-4949-8500-063319dcd004 tempest-ServerActionsTestOtherA-1591449576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:32:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6a2372ea-6fda-4949-8500-063319dcd004 tempest-ServerActionsTestOtherA-1591449576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:32:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6a2372ea-6fda-4949-8500-063319dcd004 tempest-ServerActionsTestOtherA-1591449576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:32:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a2372ea-6fda-4949-8500-063319dcd004 tempest-ServerActionsTestOtherA-1591449576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:32:49 devstack sudo[93950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:32:49 devstack sudo[93950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:32:49 devstack sudo[93950]: pam_unix(sudo:session): session closed for user root
Nov 05 09:32:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6a2372ea-6fda-4949-8500-063319dcd004 tempest-ServerActionsTestOtherA-1591449576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.310s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:32:49 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-6a2372ea-6fda-4949-8500-063319dcd004 tempest-ServerActionsTestOtherA-1591449576 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:32:49 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-6a2372ea-6fda-4949-8500-063319dcd004 tempest-ServerActionsTestOtherA-1591449576 None] Deleted volume successfully.
Nov 05 09:32:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6a2372ea-6fda-4949-8500-063319dcd004 tempest-ServerActionsTestOtherA-1591449576 None] Lock "cinder-60ab7b69-ae03-4977-bb12-2b5cdfc47e91-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:33:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:33:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:33:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:33:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:33:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:33:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:33:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:33:00 devstack sudo[94051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:33:00 devstack sudo[94051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:33:00 devstack sudo[94051]: pam_unix(sudo:session): session closed for user root
Nov 05 09:33:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.281s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:33:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:33:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:33:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 28 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:33:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>, <Thread(tpool_thread_0, started daemon 132223357408960)>, <Thread(tpool_thread_1, started daemon 132223349016256)>, <Thread(tpool_thread_2, started daemon 132223340623552)>, <Thread(tpool_thread_3, started daemon 132223332230848)>, <Thread(tpool_thread_4, started daemon 132223323838144)>, <Thread(tpool_thread_5, started daemon 132223315445440)>, <Thread(tpool_thread_6, started daemon 132223307052736)>, <Thread(tpool_thread_7, started daemon 132223298660032)>, <Thread(tpool_thread_8, started daemon 132223290250944)>, <Thread(tpool_thread_9, started daemon 132223281841856)>, <Thread(tpool_thread_10, started daemon 132223273432768)>, <Thread(tpool_thread_11, started daemon 132223265023680)>, <Thread(tpool_thread_12, started daemon 132223256614592)>, <Thread(tpool_thread_13, started daemon 132223248205504)>, <Thread(tpool_thread_14, started daemon 132223239796416)>, <Thread(tpool_thread_15, started daemon 132223231387328)>, <Thread(tpool_thread_16, started daemon 132223222978240)>, <Thread(tpool_thread_17, started daemon 132223214569152)>, <Thread(tpool_thread_18, started daemon 132223206160064)>, <Thread(tpool_thread_19, started daemon 132223197750976)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:33:06 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=17,cinder:UPDATE=18,cinder:INSERT=2 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:33:06 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=6,cinder:INSERT=6,cinder:UPDATE=15,cinder:DELETE=2 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:34:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:34:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:34:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:34:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:34:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:34:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:34:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:34:00 devstack sudo[94328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:34:00 devstack sudo[94328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:34:00 devstack sudo[94328]: pam_unix(sudo:session): session closed for user root
Nov 05 09:34:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.259s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:34:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:34:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:34:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 28 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:34:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>, <Thread(tpool_thread_0, started daemon 132223357408960)>, <Thread(tpool_thread_1, started daemon 132223349016256)>, <Thread(tpool_thread_2, started daemon 132223340623552)>, <Thread(tpool_thread_3, started daemon 132223332230848)>, <Thread(tpool_thread_4, started daemon 132223323838144)>, <Thread(tpool_thread_5, started daemon 132223315445440)>, <Thread(tpool_thread_6, started daemon 132223307052736)>, <Thread(tpool_thread_7, started daemon 132223298660032)>, <Thread(tpool_thread_8, started daemon 132223290250944)>, <Thread(tpool_thread_9, started daemon 132223281841856)>, <Thread(tpool_thread_10, started daemon 132223273432768)>, <Thread(tpool_thread_11, started daemon 132223265023680)>, <Thread(tpool_thread_12, started daemon 132223256614592)>, <Thread(tpool_thread_13, started daemon 132223248205504)>, <Thread(tpool_thread_14, started daemon 132223239796416)>, <Thread(tpool_thread_15, started daemon 132223231387328)>, <Thread(tpool_thread_16, started daemon 132223222978240)>, <Thread(tpool_thread_17, started daemon 132223214569152)>, <Thread(tpool_thread_18, started daemon 132223206160064)>, <Thread(tpool_thread_19, started daemon 132223197750976)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:34:06 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:34:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] Flow 'volume_create_manager' (4600daa6-551e-4ef5-8bfc-d7f6aa2e6fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:34:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c9f9ca-2527-4cb9-9f73-df686ac837bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:34:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c9f9ca-2527-4cb9-9f73-df686ac837bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-416464070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=437b6b1b-2bbe-4821-a3db-ac02f099fd78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a516f66062b429ba948e453ad2328df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:34:06Z,use_quota=True,user_id='5a2ff9dee61140aa9e8304bbaf0e0e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:34:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe6b7e7-c6bc-4245-8192-e62c4c717bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:34:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe6b7e7-c6bc-4245-8192-e62c4c717bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:34:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faa6586c-51d9-471f-a8c2-7cab6fa5b69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:34:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faa6586c-51d9-471f-a8c2-7cab6fa5b69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '437b6b1b-2bbe-4821-a3db-ac02f099fd78', 'volume_name': 'volume-437b6b1b-2bbe-4821-a3db-ac02f099fd78', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:34:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc405bf-a90d-4ace-b4ca-a884b09e9115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:34:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc405bf-a90d-4ace-b4ca-a884b09e9115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:34:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (173fbe84-5737-4583-9428-480eb21e3eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:34:06 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] Volume 437b6b1b-2bbe-4821-a3db-ac02f099fd78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-437b6b1b-2bbe-4821-a3db-ac02f099fd78', 'volume_size': 1}
Nov 05 09:34:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:34:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:34:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-416464070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=437b6b1b-2bbe-4821-a3db-ac02f099fd78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a516f66062b429ba948e453ad2328df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:34:06Z,use_quota=True,user_id='5a2ff9dee61140aa9e8304bbaf0e0e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:34:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] Creating volume 437b6b1b-2bbe-4821-a3db-ac02f099fd78 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:34:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:34:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:34:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:34:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:34:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:34:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:34:06 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:34:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-437b6b1b-2bbe-4821-a3db-ac02f099fd78 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:34:06 devstack sudo[94337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-437b6b1b-2bbe-4821-a3db-ac02f099fd78 1073741824
Nov 05 09:34:06 devstack sudo[94337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:34:06 devstack sudo[94337]: pam_unix(sudo:session): session closed for user root
Nov 05 09:34:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-437b6b1b-2bbe-4821-a3db-ac02f099fd78 1073741824" returned: 0 in 0.450s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:34:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-437b6b1b-2bbe-4821-a3db-ac02f099fd78 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:34:06 devstack sudo[94343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-437b6b1b-2bbe-4821-a3db-ac02f099fd78
Nov 05 09:34:06 devstack sudo[94343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:34:06 devstack sudo[94343]: pam_unix(sudo:session): session closed for user root
Nov 05 09:34:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-437b6b1b-2bbe-4821-a3db-ac02f099fd78" returned: 0 in 0.268s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:34:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:34:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:34:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (173fbe84-5737-4583-9428-480eb21e3eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-437b6b1b-2bbe-4821-a3db-ac02f099fd78', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:34:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6b94c9-e22a-4a44-9bb5-f10e44bf3201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:34:06 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] Volume volume-437b6b1b-2bbe-4821-a3db-ac02f099fd78 (437b6b1b-2bbe-4821-a3db-ac02f099fd78): created successfully
Nov 05 09:34:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6b94c9-e22a-4a44-9bb5-f10e44bf3201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:34:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] Flow 'volume_create_manager' (4600daa6-551e-4ef5-8bfc-d7f6aa2e6fcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:34:06 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-2737349b-e272-48b4-a21e-9b53ca655db4 tempest-AttachVolumeTestJSON-1037551354 None] Created volume successfully.
Nov 05 09:34:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-a27f47b2-c605-4f58-a6c0-eede1c2bd5ab req-43e2b0ba-716b-4125-b42f-92913cc29e45 tempest-AttachVolumeTestJSON-1037551354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:34:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-a27f47b2-c605-4f58-a6c0-eede1c2bd5ab req-43e2b0ba-716b-4125-b42f-92913cc29e45 tempest-AttachVolumeTestJSON-1037551354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:34:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-a27f47b2-c605-4f58-a6c0-eede1c2bd5ab req-43e2b0ba-716b-4125-b42f-92913cc29e45 tempest-AttachVolumeTestJSON-1037551354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:34:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-a27f47b2-c605-4f58-a6c0-eede1c2bd5ab req-43e2b0ba-716b-4125-b42f-92913cc29e45 tempest-AttachVolumeTestJSON-1037551354 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1', 'name': 'volume-437b6b1b-2bbe-4821-a3db-ac02f099fd78', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1a4af335-8fb4-44f2-b741-43068f8413b2', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 09:34:07 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-a27f47b2-c605-4f58-a6c0-eede1c2bd5ab req-43e2b0ba-716b-4125-b42f-92913cc29e45 tempest-AttachVolumeTestJSON-1037551354 None] attachment_update completed successfully.
Nov 05 09:34:17 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:34:17 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=5,cinder:SELECT=7 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:34:34 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-26bcafcf-a01f-45b5-9934-0b6120821315 req-9aea01da-a0fb-4d4a-ade7-4a3f33145d08 tempest-AttachVolumeTestJSON-1037551354 None] Terminate volume connection completed successfully.
Nov 05 09:34:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-26bcafcf-a01f-45b5-9934-0b6120821315 req-9aea01da-a0fb-4d4a-ade7-4a3f33145d08 tempest-AttachVolumeTestJSON-1037551354 None] Deleting attachment 1a4af335-8fb4-44f2-b741-43068f8413b2. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 09:34:44 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=2 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:35:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:35:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:35:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:35:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:35:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:35:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:35:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:35:00 devstack sudo[94656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:35:00 devstack sudo[94656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:35:00 devstack sudo[94656]: pam_unix(sudo:session): session closed for user root
Nov 05 09:35:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.281s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:35:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:35:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:35:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 28 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:35:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>, <Thread(tpool_thread_0, started daemon 132223357408960)>, <Thread(tpool_thread_1, started daemon 132223349016256)>, <Thread(tpool_thread_2, started daemon 132223340623552)>, <Thread(tpool_thread_3, started daemon 132223332230848)>, <Thread(tpool_thread_4, started daemon 132223323838144)>, <Thread(tpool_thread_5, started daemon 132223315445440)>, <Thread(tpool_thread_6, started daemon 132223307052736)>, <Thread(tpool_thread_7, started daemon 132223298660032)>, <Thread(tpool_thread_8, started daemon 132223290250944)>, <Thread(tpool_thread_9, started daemon 132223281841856)>, <Thread(tpool_thread_10, started daemon 132223273432768)>, <Thread(tpool_thread_11, started daemon 132223265023680)>, <Thread(tpool_thread_12, started daemon 132223256614592)>, <Thread(tpool_thread_13, started daemon 132223248205504)>, <Thread(tpool_thread_14, started daemon 132223239796416)>, <Thread(tpool_thread_15, started daemon 132223231387328)>, <Thread(tpool_thread_16, started daemon 132223222978240)>, <Thread(tpool_thread_17, started daemon 132223214569152)>, <Thread(tpool_thread_18, started daemon 132223206160064)>, <Thread(tpool_thread_19, started daemon 132223197750976)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:35:06 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:35:39 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:35:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] Flow 'volume_create_manager' (9365fdff-e31d-48ef-ae61-5cdc73fc7836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:35:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d1a7fd6-8375-4cd3-8291-8c690889cbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:35:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d1a7fd6-8375-4cd3-8291-8c690889cbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1932126000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf126032-6285-46fe-a0dd-15e1833e20f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a516f66062b429ba948e453ad2328df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:35:39Z,use_quota=True,user_id='5a2ff9dee61140aa9e8304bbaf0e0e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:35:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adbb070d-7d0c-491b-b160-eca393132796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:35:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adbb070d-7d0c-491b-b160-eca393132796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:35:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b309db2-1b29-49e0-a9b0-b35ac843c425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:35:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b309db2-1b29-49e0-a9b0-b35ac843c425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf126032-6285-46fe-a0dd-15e1833e20f7', 'volume_name': 'volume-cf126032-6285-46fe-a0dd-15e1833e20f7', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:35:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd0ffa8-eb49-485b-ae80-c8dd57537de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:35:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd0ffa8-eb49-485b-ae80-c8dd57537de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:35:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b272b1b-34e5-471f-87a0-daa3633e59b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:35:39 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] Volume cf126032-6285-46fe-a0dd-15e1833e20f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf126032-6285-46fe-a0dd-15e1833e20f7', 'volume_size': 1}
Nov 05 09:35:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:35:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:35:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1932126000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf126032-6285-46fe-a0dd-15e1833e20f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a516f66062b429ba948e453ad2328df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:35:39Z,use_quota=True,user_id='5a2ff9dee61140aa9e8304bbaf0e0e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:35:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] Creating volume cf126032-6285-46fe-a0dd-15e1833e20f7 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:35:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:35:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:35:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:35:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:35:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:35:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:35:39 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:35:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cf126032-6285-46fe-a0dd-15e1833e20f7 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:35:39 devstack sudo[94863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cf126032-6285-46fe-a0dd-15e1833e20f7 1073741824
Nov 05 09:35:39 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:35:39 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root
Nov 05 09:35:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cf126032-6285-46fe-a0dd-15e1833e20f7 1073741824" returned: 0 in 0.449s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:35:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cf126032-6285-46fe-a0dd-15e1833e20f7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:35:39 devstack sudo[94868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cf126032-6285-46fe-a0dd-15e1833e20f7
Nov 05 09:35:39 devstack sudo[94868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:35:40 devstack sudo[94868]: pam_unix(sudo:session): session closed for user root
Nov 05 09:35:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cf126032-6285-46fe-a0dd-15e1833e20f7" returned: 0 in 0.248s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:35:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:35:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:35:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b272b1b-34e5-471f-87a0-daa3633e59b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf126032-6285-46fe-a0dd-15e1833e20f7', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:35:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49d5eb6a-c60c-4d2a-8791-8c87b1acca75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:35:40 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] Volume volume-cf126032-6285-46fe-a0dd-15e1833e20f7 (cf126032-6285-46fe-a0dd-15e1833e20f7): created successfully
Nov 05 09:35:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49d5eb6a-c60c-4d2a-8791-8c87b1acca75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:35:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] Flow 'volume_create_manager' (9365fdff-e31d-48ef-ae61-5cdc73fc7836) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:35:40 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-33abf091-f941-41f9-8e14-a75b3d0aab53 tempest-AttachVolumeTestJSON-1037551354 None] Created volume successfully.
Nov 05 09:35:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-9b25578a-d65b-4500-811d-379a512d4d60 req-e27b382f-b45d-49a3-b5b3-6e4bb4e98e85 tempest-AttachVolumeTestJSON-1037551354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:35:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-9b25578a-d65b-4500-811d-379a512d4d60 req-e27b382f-b45d-49a3-b5b3-6e4bb4e98e85 tempest-AttachVolumeTestJSON-1037551354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:35:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-9b25578a-d65b-4500-811d-379a512d4d60 req-e27b382f-b45d-49a3-b5b3-6e4bb4e98e85 tempest-AttachVolumeTestJSON-1037551354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:35:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-9b25578a-d65b-4500-811d-379a512d4d60 req-e27b382f-b45d-49a3-b5b3-6e4bb4e98e85 tempest-AttachVolumeTestJSON-1037551354 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1', 'name': 'volume-cf126032-6285-46fe-a0dd-15e1833e20f7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c1b73e7d-129a-4873-a7f1-f52beee37e86', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 09:35:41 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-9b25578a-d65b-4500-811d-379a512d4d60 req-e27b382f-b45d-49a3-b5b3-6e4bb4e98e85 tempest-AttachVolumeTestJSON-1037551354 None] attachment_update completed successfully.
Nov 05 09:35:42 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:35:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] Flow 'volume_create_manager' (ca3beac9-2357-4cfc-a418-505478887c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:35:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a87ecce-b52c-4fb4-b59d-a19611a599b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:35:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a87ecce-b52c-4fb4-b59d-a19611a599b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-389728283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=537dda1e-eef9-49ea-95b1-187a17629650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a516f66062b429ba948e453ad2328df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:35:43Z,use_quota=True,user_id='5a2ff9dee61140aa9e8304bbaf0e0e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:35:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f53ec9f-a1aa-4617-8289-57a5e3a4c5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:35:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f53ec9f-a1aa-4617-8289-57a5e3a4c5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:35:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e56b9a43-c74e-4378-bc79-dc3557a73555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:35:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e56b9a43-c74e-4378-bc79-dc3557a73555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '537dda1e-eef9-49ea-95b1-187a17629650', 'volume_name': 'volume-537dda1e-eef9-49ea-95b1-187a17629650', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:35:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb6dd738-ba39-4a1b-9e42-cdf9b62595b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:35:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb6dd738-ba39-4a1b-9e42-cdf9b62595b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:35:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9631e25f-97a3-4fda-9661-1f463bce2ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:35:42 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] Volume 537dda1e-eef9-49ea-95b1-187a17629650: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-537dda1e-eef9-49ea-95b1-187a17629650', 'volume_size': 1}
Nov 05 09:35:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:35:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:35:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-389728283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=537dda1e-eef9-49ea-95b1-187a17629650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a516f66062b429ba948e453ad2328df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:35:43Z,use_quota=True,user_id='5a2ff9dee61140aa9e8304bbaf0e0e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:35:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] Creating volume 537dda1e-eef9-49ea-95b1-187a17629650 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:35:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:35:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:35:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:35:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:35:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:35:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:35:42 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:35:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-537dda1e-eef9-49ea-95b1-187a17629650 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:35:43 devstack sudo[94893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-537dda1e-eef9-49ea-95b1-187a17629650 1073741824
Nov 05 09:35:43 devstack sudo[94893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:35:43 devstack sudo[94893]: pam_unix(sudo:session): session closed for user root
Nov 05 09:35:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-537dda1e-eef9-49ea-95b1-187a17629650 1073741824" returned: 0 in 0.498s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:35:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-537dda1e-eef9-49ea-95b1-187a17629650 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:35:43 devstack sudo[94899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-537dda1e-eef9-49ea-95b1-187a17629650
Nov 05 09:35:43 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:35:43 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root
Nov 05 09:35:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-537dda1e-eef9-49ea-95b1-187a17629650" returned: 0 in 0.283s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:35:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:35:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:35:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9631e25f-97a3-4fda-9661-1f463bce2ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-537dda1e-eef9-49ea-95b1-187a17629650', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:35:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c0628a-a72b-4f43-a1a8-e8e456e94ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:35:43 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] Volume volume-537dda1e-eef9-49ea-95b1-187a17629650 (537dda1e-eef9-49ea-95b1-187a17629650): created successfully
Nov 05 09:35:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c0628a-a72b-4f43-a1a8-e8e456e94ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:35:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] Flow 'volume_create_manager' (ca3beac9-2357-4cfc-a418-505478887c1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:35:43 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-9167726c-5a94-476c-af5f-15e5f67467f9 tempest-AttachVolumeTestJSON-1037551354 None] Created volume successfully.
Nov 05 09:35:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-7ee49b4e-f095-4aac-9a15-52fe2509f1cc req-73e404c5-7945-4b0c-b491-034f48f214c4 tempest-AttachVolumeTestJSON-1037551354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:35:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-7ee49b4e-f095-4aac-9a15-52fe2509f1cc req-73e404c5-7945-4b0c-b491-034f48f214c4 tempest-AttachVolumeTestJSON-1037551354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:35:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-7ee49b4e-f095-4aac-9a15-52fe2509f1cc req-73e404c5-7945-4b0c-b491-034f48f214c4 tempest-AttachVolumeTestJSON-1037551354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:35:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-7ee49b4e-f095-4aac-9a15-52fe2509f1cc req-73e404c5-7945-4b0c-b491-034f48f214c4 tempest-AttachVolumeTestJSON-1037551354 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1', 'name': 'volume-537dda1e-eef9-49ea-95b1-187a17629650', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '37809445-54f2-41a2-aece-5a91ba7dad71', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 09:35:45 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-7ee49b4e-f095-4aac-9a15-52fe2509f1cc req-73e404c5-7945-4b0c-b491-034f48f214c4 tempest-AttachVolumeTestJSON-1037551354 None] attachment_update completed successfully.
Nov 05 09:35:47 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-35f84ec0-5f96-45a6-97b1-2b1f04d59071 req-e69ba871-75d4-4d6d-9a09-b67974eeae66 tempest-AttachVolumeTestJSON-1037551354 None] Terminate volume connection completed successfully.
Nov 05 09:35:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-35f84ec0-5f96-45a6-97b1-2b1f04d59071 req-e69ba871-75d4-4d6d-9a09-b67974eeae66 tempest-AttachVolumeTestJSON-1037551354 None] Deleting attachment c1b73e7d-129a-4873-a7f1-f52beee37e86. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 09:35:48 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-ec2d0747-5147-4b15-ae07-c8be48df5ccf req-7164f9c4-62fc-4978-9fd1-d4311fe9d648 tempest-AttachVolumeTestJSON-1037551354 None] Terminate volume connection completed successfully.
Nov 05 09:35:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-ec2d0747-5147-4b15-ae07-c8be48df5ccf req-7164f9c4-62fc-4978-9fd1-d4311fe9d648 tempest-AttachVolumeTestJSON-1037551354 None] Deleting attachment 37809445-54f2-41a2-aece-5a91ba7dad71. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 09:35:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2fde1d20-e078-48b8-8382-b50bde30f457 tempest-AttachVolumeTestJSON-1037551354 None] Acquiring lock "cinder-537dda1e-eef9-49ea-95b1-187a17629650-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:35:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2fde1d20-e078-48b8-8382-b50bde30f457 tempest-AttachVolumeTestJSON-1037551354 None] Lock "cinder-537dda1e-eef9-49ea-95b1-187a17629650-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:35:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2fde1d20-e078-48b8-8382-b50bde30f457 tempest-AttachVolumeTestJSON-1037551354 None] Acquiring lock "cinder-quobyte-537dda1e-eef9-49ea-95b1-187a17629650" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:35:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2fde1d20-e078-48b8-8382-b50bde30f457 tempest-AttachVolumeTestJSON-1037551354 None] Lock "cinder-quobyte-537dda1e-eef9-49ea-95b1-187a17629650" acquired by "delete_volume" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:35:54 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[986fef72-889c-4f83-8d7b-a1a993f2d6e1]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:35:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2fde1d20-e078-48b8-8382-b50bde30f457 tempest-AttachVolumeTestJSON-1037551354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-537dda1e-eef9-49ea-95b1-187a17629650 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:35:54 devstack sudo[94951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-537dda1e-eef9-49ea-95b1-187a17629650
Nov 05 09:35:54 devstack sudo[94951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:35:54 devstack sudo[94951]: pam_unix(sudo:session): session closed for user root
Nov 05 09:35:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2fde1d20-e078-48b8-8382-b50bde30f457 tempest-AttachVolumeTestJSON-1037551354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-537dda1e-eef9-49ea-95b1-187a17629650" returned: 0 in 0.380s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:35:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2fde1d20-e078-48b8-8382-b50bde30f457 tempest-AttachVolumeTestJSON-1037551354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-537dda1e-eef9-49ea-95b1-187a17629650 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:35:54 devstack sudo[94956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-537dda1e-eef9-49ea-95b1-187a17629650
Nov 05 09:35:54 devstack sudo[94956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:35:55 devstack sudo[94956]: pam_unix(sudo:session): session closed for user root
Nov 05 09:35:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2fde1d20-e078-48b8-8382-b50bde30f457 tempest-AttachVolumeTestJSON-1037551354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-537dda1e-eef9-49ea-95b1-187a17629650" returned: 0 in 0.255s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:35:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2fde1d20-e078-48b8-8382-b50bde30f457 tempest-AttachVolumeTestJSON-1037551354 None] Lock "cinder-quobyte-537dda1e-eef9-49ea-95b1-187a17629650" released by "delete_volume" :: held 0.690s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:35:55 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-2fde1d20-e078-48b8-8382-b50bde30f457 tempest-AttachVolumeTestJSON-1037551354 None] Created reservations ['b59a487a-d2c1-418a-b369-2dc188faf5b5', '4e9bed04-45a3-4e83-814c-bbba98d42e37', 'ff66341d-dd2a-4c26-87d5-390c8e050049', '7c96124e-1357-4ac0-8ec3-a27f22801b61'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:35:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2fde1d20-e078-48b8-8382-b50bde30f457 tempest-AttachVolumeTestJSON-1037551354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:35:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2fde1d20-e078-48b8-8382-b50bde30f457 tempest-AttachVolumeTestJSON-1037551354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:35:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2fde1d20-e078-48b8-8382-b50bde30f457 tempest-AttachVolumeTestJSON-1037551354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:35:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2fde1d20-e078-48b8-8382-b50bde30f457 tempest-AttachVolumeTestJSON-1037551354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:35:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2fde1d20-e078-48b8-8382-b50bde30f457 tempest-AttachVolumeTestJSON-1037551354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:35:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2fde1d20-e078-48b8-8382-b50bde30f457 tempest-AttachVolumeTestJSON-1037551354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:35:55 devstack sudo[94959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:35:55 devstack sudo[94959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:35:55 devstack sudo[94959]: pam_unix(sudo:session): session closed for user root
Nov 05 09:35:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2fde1d20-e078-48b8-8382-b50bde30f457 tempest-AttachVolumeTestJSON-1037551354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.257s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:35:55 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-2fde1d20-e078-48b8-8382-b50bde30f457 tempest-AttachVolumeTestJSON-1037551354 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:35:55 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-2fde1d20-e078-48b8-8382-b50bde30f457 tempest-AttachVolumeTestJSON-1037551354 None] Deleted volume successfully.
Nov 05 09:35:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2fde1d20-e078-48b8-8382-b50bde30f457 tempest-AttachVolumeTestJSON-1037551354 None] Lock "cinder-537dda1e-eef9-49ea-95b1-187a17629650-delete_volume" released by "delete_volume" :: held 1.174s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:35:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-14200819-1fe2-4069-9701-3ae3b1f5b1b4 tempest-AttachVolumeTestJSON-1037551354 None] Acquiring lock "cinder-cf126032-6285-46fe-a0dd-15e1833e20f7-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:35:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-14200819-1fe2-4069-9701-3ae3b1f5b1b4 tempest-AttachVolumeTestJSON-1037551354 None] Lock "cinder-cf126032-6285-46fe-a0dd-15e1833e20f7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:35:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-14200819-1fe2-4069-9701-3ae3b1f5b1b4 tempest-AttachVolumeTestJSON-1037551354 None] Acquiring lock "cinder-quobyte-cf126032-6285-46fe-a0dd-15e1833e20f7" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:35:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-14200819-1fe2-4069-9701-3ae3b1f5b1b4 tempest-AttachVolumeTestJSON-1037551354 None] Lock "cinder-quobyte-cf126032-6285-46fe-a0dd-15e1833e20f7" acquired by "delete_volume" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:35:55 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[67108203-49bf-4466-a04b-f79693a9bf0d]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:35:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-14200819-1fe2-4069-9701-3ae3b1f5b1b4 tempest-AttachVolumeTestJSON-1037551354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cf126032-6285-46fe-a0dd-15e1833e20f7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:35:55 devstack sudo[94962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cf126032-6285-46fe-a0dd-15e1833e20f7
Nov 05 09:35:55 devstack sudo[94962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:35:56 devstack sudo[94962]: pam_unix(sudo:session): session closed for user root
Nov 05 09:35:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-14200819-1fe2-4069-9701-3ae3b1f5b1b4 tempest-AttachVolumeTestJSON-1037551354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cf126032-6285-46fe-a0dd-15e1833e20f7" returned: 0 in 0.409s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:35:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-14200819-1fe2-4069-9701-3ae3b1f5b1b4 tempest-AttachVolumeTestJSON-1037551354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cf126032-6285-46fe-a0dd-15e1833e20f7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:35:56 devstack sudo[94968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cf126032-6285-46fe-a0dd-15e1833e20f7
Nov 05 09:35:56 devstack sudo[94968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:35:56 devstack sudo[94968]: pam_unix(sudo:session): session closed for user root
Nov 05 09:35:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-14200819-1fe2-4069-9701-3ae3b1f5b1b4 tempest-AttachVolumeTestJSON-1037551354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cf126032-6285-46fe-a0dd-15e1833e20f7" returned: 0 in 0.258s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:35:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-14200819-1fe2-4069-9701-3ae3b1f5b1b4 tempest-AttachVolumeTestJSON-1037551354 None] Lock "cinder-quobyte-cf126032-6285-46fe-a0dd-15e1833e20f7" released by "delete_volume" :: held 0.719s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:35:56 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-14200819-1fe2-4069-9701-3ae3b1f5b1b4 tempest-AttachVolumeTestJSON-1037551354 None] Created reservations ['4305017a-d116-44df-9c7c-aee71bf84c86', '6ac9b95e-0520-4a7e-a9df-b823b61515b4', 'a9b5b749-dcee-479a-8ff6-40b2c18fd42d', 'fd080925-0842-4062-9158-247370299fb8'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:35:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-14200819-1fe2-4069-9701-3ae3b1f5b1b4 tempest-AttachVolumeTestJSON-1037551354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:35:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-14200819-1fe2-4069-9701-3ae3b1f5b1b4 tempest-AttachVolumeTestJSON-1037551354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:35:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-14200819-1fe2-4069-9701-3ae3b1f5b1b4 tempest-AttachVolumeTestJSON-1037551354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:35:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-14200819-1fe2-4069-9701-3ae3b1f5b1b4 tempest-AttachVolumeTestJSON-1037551354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:35:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-14200819-1fe2-4069-9701-3ae3b1f5b1b4 tempest-AttachVolumeTestJSON-1037551354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:35:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-14200819-1fe2-4069-9701-3ae3b1f5b1b4 tempest-AttachVolumeTestJSON-1037551354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:35:56 devstack sudo[94971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:35:56 devstack sudo[94971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:35:56 devstack sudo[94971]: pam_unix(sudo:session): session closed for user root
Nov 05 09:35:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-14200819-1fe2-4069-9701-3ae3b1f5b1b4 tempest-AttachVolumeTestJSON-1037551354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.262s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:35:56 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-14200819-1fe2-4069-9701-3ae3b1f5b1b4 tempest-AttachVolumeTestJSON-1037551354 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:35:56 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-14200819-1fe2-4069-9701-3ae3b1f5b1b4 tempest-AttachVolumeTestJSON-1037551354 None] Deleted volume successfully.
Nov 05 09:35:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-14200819-1fe2-4069-9701-3ae3b1f5b1b4 tempest-AttachVolumeTestJSON-1037551354 None] Lock "cinder-cf126032-6285-46fe-a0dd-15e1833e20f7-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:35:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9293fb27-d0de-4270-94e4-e22c1973982e tempest-AttachVolumeTestJSON-1037551354 None] Acquiring lock "cinder-437b6b1b-2bbe-4821-a3db-ac02f099fd78-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:35:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9293fb27-d0de-4270-94e4-e22c1973982e tempest-AttachVolumeTestJSON-1037551354 None] Lock "cinder-437b6b1b-2bbe-4821-a3db-ac02f099fd78-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:35:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9293fb27-d0de-4270-94e4-e22c1973982e tempest-AttachVolumeTestJSON-1037551354 None] Acquiring lock "cinder-quobyte-437b6b1b-2bbe-4821-a3db-ac02f099fd78" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:35:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9293fb27-d0de-4270-94e4-e22c1973982e tempest-AttachVolumeTestJSON-1037551354 None] Lock "cinder-quobyte-437b6b1b-2bbe-4821-a3db-ac02f099fd78" acquired by "delete_volume" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:35:56 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d4397b-d252-437a-80fd-0cb7bc29eb5a]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:35:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9293fb27-d0de-4270-94e4-e22c1973982e tempest-AttachVolumeTestJSON-1037551354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-437b6b1b-2bbe-4821-a3db-ac02f099fd78 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:35:57 devstack sudo[94974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-437b6b1b-2bbe-4821-a3db-ac02f099fd78
Nov 05 09:35:57 devstack sudo[94974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:35:57 devstack sudo[94974]: pam_unix(sudo:session): session closed for user root
Nov 05 09:35:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9293fb27-d0de-4270-94e4-e22c1973982e tempest-AttachVolumeTestJSON-1037551354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-437b6b1b-2bbe-4821-a3db-ac02f099fd78" returned: 0 in 0.375s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:35:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9293fb27-d0de-4270-94e4-e22c1973982e tempest-AttachVolumeTestJSON-1037551354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-437b6b1b-2bbe-4821-a3db-ac02f099fd78 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:35:57 devstack sudo[94980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-437b6b1b-2bbe-4821-a3db-ac02f099fd78
Nov 05 09:35:57 devstack sudo[94980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:35:57 devstack sudo[94980]: pam_unix(sudo:session): session closed for user root
Nov 05 09:35:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9293fb27-d0de-4270-94e4-e22c1973982e tempest-AttachVolumeTestJSON-1037551354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-437b6b1b-2bbe-4821-a3db-ac02f099fd78" returned: 0 in 0.247s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:35:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9293fb27-d0de-4270-94e4-e22c1973982e tempest-AttachVolumeTestJSON-1037551354 None] Lock "cinder-quobyte-437b6b1b-2bbe-4821-a3db-ac02f099fd78" released by "delete_volume" :: held 0.678s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:35:57 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-9293fb27-d0de-4270-94e4-e22c1973982e tempest-AttachVolumeTestJSON-1037551354 None] Created reservations ['edcaf226-1932-46a8-bd95-b2fa4a9c923b', 'a4149123-41f4-411c-b72e-b671fc6a120d', 'cdca1033-d040-4f3f-817a-045c708c7f7a', 'bea7e1db-5603-41b3-afde-7af28fda96a0'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:35:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9293fb27-d0de-4270-94e4-e22c1973982e tempest-AttachVolumeTestJSON-1037551354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:35:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9293fb27-d0de-4270-94e4-e22c1973982e tempest-AttachVolumeTestJSON-1037551354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:35:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9293fb27-d0de-4270-94e4-e22c1973982e tempest-AttachVolumeTestJSON-1037551354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:35:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9293fb27-d0de-4270-94e4-e22c1973982e tempest-AttachVolumeTestJSON-1037551354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:35:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9293fb27-d0de-4270-94e4-e22c1973982e tempest-AttachVolumeTestJSON-1037551354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:35:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9293fb27-d0de-4270-94e4-e22c1973982e tempest-AttachVolumeTestJSON-1037551354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:35:57 devstack sudo[94983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:35:57 devstack sudo[94983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:35:57 devstack sudo[94983]: pam_unix(sudo:session): session closed for user root
Nov 05 09:35:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9293fb27-d0de-4270-94e4-e22c1973982e tempest-AttachVolumeTestJSON-1037551354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.263s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:35:57 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-9293fb27-d0de-4270-94e4-e22c1973982e tempest-AttachVolumeTestJSON-1037551354 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:35:57 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-9293fb27-d0de-4270-94e4-e22c1973982e tempest-AttachVolumeTestJSON-1037551354 None] Deleted volume successfully.
Nov 05 09:35:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9293fb27-d0de-4270-94e4-e22c1973982e tempest-AttachVolumeTestJSON-1037551354 None] Lock "cinder-437b6b1b-2bbe-4821-a3db-ac02f099fd78-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:36:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:36:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:36:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:36:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:36:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:36:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:36:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:00 devstack sudo[94988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:36:00 devstack sudo[94988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:00 devstack sudo[94988]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.275s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:36:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:36:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 28 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:36:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>, <Thread(tpool_thread_0, started daemon 132223357408960)>, <Thread(tpool_thread_1, started daemon 132223349016256)>, <Thread(tpool_thread_2, started daemon 132223340623552)>, <Thread(tpool_thread_3, started daemon 132223332230848)>, <Thread(tpool_thread_4, started daemon 132223323838144)>, <Thread(tpool_thread_5, started daemon 132223315445440)>, <Thread(tpool_thread_6, started daemon 132223307052736)>, <Thread(tpool_thread_7, started daemon 132223298660032)>, <Thread(tpool_thread_8, started daemon 132223290250944)>, <Thread(tpool_thread_9, started daemon 132223281841856)>, <Thread(tpool_thread_10, started daemon 132223273432768)>, <Thread(tpool_thread_11, started daemon 132223265023680)>, <Thread(tpool_thread_12, started daemon 132223256614592)>, <Thread(tpool_thread_13, started daemon 132223248205504)>, <Thread(tpool_thread_14, started daemon 132223239796416)>, <Thread(tpool_thread_15, started daemon 132223231387328)>, <Thread(tpool_thread_16, started daemon 132223222978240)>, <Thread(tpool_thread_17, started daemon 132223214569152)>, <Thread(tpool_thread_18, started daemon 132223206160064)>, <Thread(tpool_thread_19, started daemon 132223197750976)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:36:07 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=39,cinder:SELECT=32,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:36:07 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=36,cinder:UPDATE=27,cinder:INSERT=9,cinder:DELETE=3 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:36:13 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:36:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Flow 'volume_create_manager' (82741ab6-e802-4e2f-a90d-bbce2511010d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:36:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (364cd126-be9d-485e-a9b3-01d7ddc6c74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (364cd126-be9d-485e-a9b3-01d7ddc6c74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-738193813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=266d91f2-c118-43ce-8367-2b1d14277222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8816ba2820e9423dbf10838a771e10ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:36:13Z,use_quota=True,user_id='50f1a98005c84634bd376c850225a91b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (379d71c2-e29d-486d-83bc-0ccb0de31e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (379d71c2-e29d-486d-83bc-0ccb0de31e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b201321-22da-415f-897a-154b408ac355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b201321-22da-415f-897a-154b408ac355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '266d91f2-c118-43ce-8367-2b1d14277222', 'volume_name': 'volume-266d91f2-c118-43ce-8367-2b1d14277222', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b0e621-9084-4f72-a800-60cd4f692c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b0e621-9084-4f72-a800-60cd4f692c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (492bc639-d227-4589-a951-8d85d8cda66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:13 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Volume 266d91f2-c118-43ce-8367-2b1d14277222: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-266d91f2-c118-43ce-8367-2b1d14277222', 'volume_size': 1}
Nov 05 09:36:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:36:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:36:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-738193813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=266d91f2-c118-43ce-8367-2b1d14277222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8816ba2820e9423dbf10838a771e10ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:36:13Z,use_quota=True,user_id='50f1a98005c84634bd376c850225a91b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:36:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Creating volume 266d91f2-c118-43ce-8367-2b1d14277222 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:36:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:36:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:36:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:36:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:36:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:36:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:36:13 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:36:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:13 devstack sudo[95020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222 1073741824
Nov 05 09:36:13 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:13 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222 1073741824" returned: 0 in 0.462s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:13 devstack sudo[95026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222
Nov 05 09:36:13 devstack sudo[95026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:14 devstack sudo[95026]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222" returned: 0 in 0.262s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:36:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:36:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (492bc639-d227-4589-a951-8d85d8cda66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-266d91f2-c118-43ce-8367-2b1d14277222', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a1199d-6952-4583-b38f-6a4df4d66ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:14 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Volume volume-266d91f2-c118-43ce-8367-2b1d14277222 (266d91f2-c118-43ce-8367-2b1d14277222): created successfully
Nov 05 09:36:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a1199d-6952-4583-b38f-6a4df4d66ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Flow 'volume_create_manager' (82741ab6-e802-4e2f-a90d-bbce2511010d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:36:14 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f089e304-4b18-46c3-8752-97f3db1dda0e tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Created volume successfully.
Nov 05 09:36:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4aa4dbd6-c048-41ed-acfc-edc2641ad252 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:36:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4aa4dbd6-c048-41ed-acfc-edc2641ad252 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:36:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-4aa4dbd6-c048-41ed-acfc-edc2641ad252 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Creating offline snapshot 0cef98d9-6faa-4cc1-a091-4d546d35cb81 of volume 266d91f2-c118-43ce-8367-2b1d14277222 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 09:36:14 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2a5354-7e45-4dbf-98a3-d4301fd45d3b]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:36:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4aa4dbd6-c048-41ed-acfc-edc2641ad252 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:14 devstack sudo[95029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222
Nov 05 09:36:14 devstack sudo[95029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:14 devstack sudo[95029]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4aa4dbd6-c048-41ed-acfc-edc2641ad252 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222" returned: 0 in 0.383s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4aa4dbd6-c048-41ed-acfc-edc2641ad252 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222.0cef98d9-6faa-4cc1-a091-4d546d35cb81 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:14 devstack sudo[95034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222.0cef98d9-6faa-4cc1-a091-4d546d35cb81 1G
Nov 05 09:36:14 devstack sudo[95034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:15 devstack sudo[95034]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4aa4dbd6-c048-41ed-acfc-edc2641ad252 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222.0cef98d9-6faa-4cc1-a091-4d546d35cb81 1G" returned: 0 in 0.426s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4aa4dbd6-c048-41ed-acfc-edc2641ad252 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-266d91f2-c118-43ce-8367-2b1d14277222 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222.0cef98d9-6faa-4cc1-a091-4d546d35cb81 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:15 devstack sudo[95040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-266d91f2-c118-43ce-8367-2b1d14277222 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222.0cef98d9-6faa-4cc1-a091-4d546d35cb81
Nov 05 09:36:15 devstack sudo[95040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:15 devstack sudo[95040]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4aa4dbd6-c048-41ed-acfc-edc2641ad252 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-266d91f2-c118-43ce-8367-2b1d14277222 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222.0cef98d9-6faa-4cc1-a091-4d546d35cb81" returned: 0 in 0.313s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:15 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-4aa4dbd6-c048-41ed-acfc-edc2641ad252 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222.0cef98d9-6faa-4cc1-a091-4d546d35cb81 is being set with open permissions: ugo+rw
Nov 05 09:36:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4aa4dbd6-c048-41ed-acfc-edc2641ad252 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222.0cef98d9-6faa-4cc1-a091-4d546d35cb81 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:15 devstack sudo[95045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222.0cef98d9-6faa-4cc1-a091-4d546d35cb81
Nov 05 09:36:15 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:15 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4aa4dbd6-c048-41ed-acfc-edc2641ad252 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222.0cef98d9-6faa-4cc1-a091-4d546d35cb81" returned: 0 in 0.273s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4aa4dbd6-c048-41ed-acfc-edc2641ad252 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:16 devstack sudo[95049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222.info
Nov 05 09:36:16 devstack sudo[95049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:16 devstack sudo[95049]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4aa4dbd6-c048-41ed-acfc-edc2641ad252 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222.info" returned: 0 in 0.263s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:16 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-4aa4dbd6-c048-41ed-acfc-edc2641ad252 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222.info is being set with open permissions: ugo+rw
Nov 05 09:36:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4aa4dbd6-c048-41ed-acfc-edc2641ad252 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:16 devstack sudo[95052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222.info
Nov 05 09:36:16 devstack sudo[95052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:16 devstack sudo[95052]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4aa4dbd6-c048-41ed-acfc-edc2641ad252 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222.info" returned: 0 in 0.251s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4aa4dbd6-c048-41ed-acfc-edc2641ad252 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.028s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:36:16 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-4aa4dbd6-c048-41ed-acfc-edc2641ad252 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Create snapshot completed successfully
Nov 05 09:36:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3b6f101e-812f-41f8-aac2-0aecbee2f0b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Acquiring lock "cinder-0cef98d9-6faa-4cc1-a091-4d546d35cb81-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:36:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3b6f101e-812f-41f8-aac2-0aecbee2f0b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Lock "cinder-0cef98d9-6faa-4cc1-a091-4d546d35cb81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:36:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3b6f101e-812f-41f8-aac2-0aecbee2f0b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Acquiring lock "cinder-quobyte-266d91f2-c118-43ce-8367-2b1d14277222" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:36:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3b6f101e-812f-41f8-aac2-0aecbee2f0b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Lock "cinder-quobyte-266d91f2-c118-43ce-8367-2b1d14277222" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:36:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3b6f101e-812f-41f8-aac2-0aecbee2f0b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Acquiring lock "cinder-quobyte-0cef98d9-6faa-4cc1-a091-4d546d35cb81" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:36:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3b6f101e-812f-41f8-aac2-0aecbee2f0b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Lock "cinder-quobyte-0cef98d9-6faa-4cc1-a091-4d546d35cb81" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:36:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-3b6f101e-812f-41f8-aac2-0aecbee2f0b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Deleting offline snapshot 0cef98d9-6faa-4cc1-a091-4d546d35cb81 of volume 266d91f2-c118-43ce-8367-2b1d14277222 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 09:36:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-3b6f101e-812f-41f8-aac2-0aecbee2f0b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] snapshot_file for this snap is: volume-266d91f2-c118-43ce-8367-2b1d14277222.0cef98d9-6faa-4cc1-a091-4d546d35cb81 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 09:36:18 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5d197b-75d1-4f6b-b6dc-91fcd8c736e4]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:36:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3b6f101e-812f-41f8-aac2-0aecbee2f0b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222.0cef98d9-6faa-4cc1-a091-4d546d35cb81 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:18 devstack sudo[95055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222.0cef98d9-6faa-4cc1-a091-4d546d35cb81
Nov 05 09:36:18 devstack sudo[95055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:18 devstack sudo[95055]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3b6f101e-812f-41f8-aac2-0aecbee2f0b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222.0cef98d9-6faa-4cc1-a091-4d546d35cb81" returned: 0 in 0.419s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-3b6f101e-812f-41f8-aac2-0aecbee2f0b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-266d91f2-c118-43ce-8367-2b1d14277222(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:36:18 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb897d1-a5d7-4e3b-b875-aa1a8967eb47]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:36:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3b6f101e-812f-41f8-aac2-0aecbee2f0b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:18 devstack sudo[95060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222
Nov 05 09:36:18 devstack sudo[95060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:18 devstack sudo[95060]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3b6f101e-812f-41f8-aac2-0aecbee2f0b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222" returned: 0 in 0.388s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3b6f101e-812f-41f8-aac2-0aecbee2f0b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222.0cef98d9-6faa-4cc1-a091-4d546d35cb81 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:19 devstack sudo[95066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222.0cef98d9-6faa-4cc1-a091-4d546d35cb81
Nov 05 09:36:19 devstack sudo[95066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:19 devstack sudo[95066]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3b6f101e-812f-41f8-aac2-0aecbee2f0b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222.0cef98d9-6faa-4cc1-a091-4d546d35cb81" returned: 0 in 0.336s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3b6f101e-812f-41f8-aac2-0aecbee2f0b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222.0cef98d9-6faa-4cc1-a091-4d546d35cb81 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:19 devstack sudo[95071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222.0cef98d9-6faa-4cc1-a091-4d546d35cb81
Nov 05 09:36:19 devstack sudo[95071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:19 devstack sudo[95071]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3b6f101e-812f-41f8-aac2-0aecbee2f0b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222.0cef98d9-6faa-4cc1-a091-4d546d35cb81" returned: 0 in 0.251s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3b6f101e-812f-41f8-aac2-0aecbee2f0b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Lock "cinder-quobyte-0cef98d9-6faa-4cc1-a091-4d546d35cb81" released by "_delete_snapshot" :: held 1.536s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:36:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3b6f101e-812f-41f8-aac2-0aecbee2f0b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Lock "cinder-quobyte-266d91f2-c118-43ce-8367-2b1d14277222" released by "delete_snapshot" :: held 1.562s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:36:19 devstack cinder-volume[86649]: WARNING cinder.quota [None req-3b6f101e-812f-41f8-aac2-0aecbee2f0b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 05 09:36:19 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-3b6f101e-812f-41f8-aac2-0aecbee2f0b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Created reservations ['dded2c94-5108-4f97-a064-bc078a079fce', '37350d3a-136e-4912-8f6b-bf9890057618', 'a278b297-846b-4b08-9911-f1ef9f6ad5a0', '13eab0ce-2330-402b-b733-27ea8fbb9562'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:36:19 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-3b6f101e-812f-41f8-aac2-0aecbee2f0b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Delete snapshot completed successfully.
Nov 05 09:36:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3b6f101e-812f-41f8-aac2-0aecbee2f0b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Lock "cinder-0cef98d9-6faa-4cc1-a091-4d546d35cb81-delete_snapshot" released by "delete_snapshot" :: held 1.745s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:36:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-19bbd41c-65bf-48e2-b88a-23bf5f298610 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Acquiring lock "cinder-266d91f2-c118-43ce-8367-2b1d14277222-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:36:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-19bbd41c-65bf-48e2-b88a-23bf5f298610 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Lock "cinder-266d91f2-c118-43ce-8367-2b1d14277222-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:36:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-19bbd41c-65bf-48e2-b88a-23bf5f298610 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Acquiring lock "cinder-quobyte-266d91f2-c118-43ce-8367-2b1d14277222" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:36:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-19bbd41c-65bf-48e2-b88a-23bf5f298610 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Lock "cinder-quobyte-266d91f2-c118-43ce-8367-2b1d14277222" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:36:20 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e2ad99-2bc1-45a2-a67f-18093205d645]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:36:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-19bbd41c-65bf-48e2-b88a-23bf5f298610 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:20 devstack sudo[95074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222
Nov 05 09:36:20 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:20 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-19bbd41c-65bf-48e2-b88a-23bf5f298610 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222" returned: 0 in 0.365s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-19bbd41c-65bf-48e2-b88a-23bf5f298610 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:20 devstack sudo[95079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222
Nov 05 09:36:20 devstack sudo[95079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:20 devstack sudo[95079]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-19bbd41c-65bf-48e2-b88a-23bf5f298610 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-266d91f2-c118-43ce-8367-2b1d14277222" returned: 0 in 0.258s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-19bbd41c-65bf-48e2-b88a-23bf5f298610 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Lock "cinder-quobyte-266d91f2-c118-43ce-8367-2b1d14277222" released by "delete_volume" :: held 0.693s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:36:21 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-19bbd41c-65bf-48e2-b88a-23bf5f298610 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Created reservations ['26e8d3b7-6afd-4af3-ae6d-60e333bb390b', 'b424e9c0-8d45-437f-8a24-1e9ec0f4ef67', '6ce85edd-f50f-40ef-92ee-c11b83c4825c', 'b614c851-8d86-46a9-b71f-747f3d79102a'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:36:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-19bbd41c-65bf-48e2-b88a-23bf5f298610 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:36:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-19bbd41c-65bf-48e2-b88a-23bf5f298610 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:36:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-19bbd41c-65bf-48e2-b88a-23bf5f298610 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:36:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-19bbd41c-65bf-48e2-b88a-23bf5f298610 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:36:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-19bbd41c-65bf-48e2-b88a-23bf5f298610 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:36:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-19bbd41c-65bf-48e2-b88a-23bf5f298610 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:21 devstack sudo[95082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:36:21 devstack sudo[95082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:21 devstack sudo[95082]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-19bbd41c-65bf-48e2-b88a-23bf5f298610 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.278s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:21 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-19bbd41c-65bf-48e2-b88a-23bf5f298610 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:36:21 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-19bbd41c-65bf-48e2-b88a-23bf5f298610 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Deleted volume successfully.
Nov 05 09:36:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-19bbd41c-65bf-48e2-b88a-23bf5f298610 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104982438 None] Lock "cinder-266d91f2-c118-43ce-8367-2b1d14277222-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:36:31 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=18,cinder:UPDATE=18,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:36:31 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=18,cinder:SELECT=14,cinder:INSERT=7,cinder:DELETE=2 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:36:40 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:36:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] Flow 'volume_create_manager' (b3621176-f487-4379-b9c4-155fa27d0584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:36:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae9e32e8-35cc-4b5a-9d33-7d399c1fe680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae9e32e8-35cc-4b5a-9d33-7d399c1fe680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1382865777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=525611c1-9140-478f-b6b9-a09f0991c1bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c7c68d8754418c878eef0a77d523c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:36:40Z,use_quota=True,user_id='f8c3347ee1cd44de800ae8d54951deb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad07d04-2bde-4ef6-bc88-785a9fa904a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad07d04-2bde-4ef6-bc88-785a9fa904a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b14b3d57-57c4-48e7-bb88-4e669de3fc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b14b3d57-57c4-48e7-bb88-4e669de3fc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '525611c1-9140-478f-b6b9-a09f0991c1bc', 'volume_name': 'volume-525611c1-9140-478f-b6b9-a09f0991c1bc', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe48749-c3fe-414a-8813-f574a45f1f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe48749-c3fe-414a-8813-f574a45f1f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c65191f-f644-41e1-b11a-6b8761880d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:40 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] Volume 525611c1-9140-478f-b6b9-a09f0991c1bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-525611c1-9140-478f-b6b9-a09f0991c1bc', 'volume_size': 1}
Nov 05 09:36:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:36:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:36:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1382865777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=525611c1-9140-478f-b6b9-a09f0991c1bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c7c68d8754418c878eef0a77d523c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:36:40Z,use_quota=True,user_id='f8c3347ee1cd44de800ae8d54951deb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:36:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] Creating volume 525611c1-9140-478f-b6b9-a09f0991c1bc {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:36:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:36:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:36:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:36:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:36:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:36:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:36:40 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:36:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-525611c1-9140-478f-b6b9-a09f0991c1bc 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:40 devstack sudo[95126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-525611c1-9140-478f-b6b9-a09f0991c1bc 1073741824
Nov 05 09:36:40 devstack sudo[95126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:40 devstack sudo[95126]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-525611c1-9140-478f-b6b9-a09f0991c1bc 1073741824" returned: 0 in 0.433s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-525611c1-9140-478f-b6b9-a09f0991c1bc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:40 devstack sudo[95138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-525611c1-9140-478f-b6b9-a09f0991c1bc
Nov 05 09:36:40 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:41 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-525611c1-9140-478f-b6b9-a09f0991c1bc" returned: 0 in 0.255s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:36:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:36:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c65191f-f644-41e1-b11a-6b8761880d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-525611c1-9140-478f-b6b9-a09f0991c1bc', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (810b9ebb-26aa-4046-9125-ee995540f104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:41 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] Volume volume-525611c1-9140-478f-b6b9-a09f0991c1bc (525611c1-9140-478f-b6b9-a09f0991c1bc): created successfully
Nov 05 09:36:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (810b9ebb-26aa-4046-9125-ee995540f104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] Flow 'volume_create_manager' (b3621176-f487-4379-b9c4-155fa27d0584) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:36:41 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-5c9b81f5-0803-4d95-8a15-6b6ac6071dd7 tempest-VolumesListAdminTestJSON-195497006 None] Created volume successfully.
Nov 05 09:36:41 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:36:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] Flow 'volume_create_manager' (f80b20bb-ea3a-4373-a231-e2c3b3ae58a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:36:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d98e6a7-3a3b-4dea-bb8b-b3b363031341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d98e6a7-3a3b-4dea-bb8b-b3b363031341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1151335430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b0f77d-d025-47e6-8363-5c30b3f9af2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c7c68d8754418c878eef0a77d523c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:36:42Z,use_quota=True,user_id='f8c3347ee1cd44de800ae8d54951deb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be4b9c1-1c5e-4508-a9d1-793e50835178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be4b9c1-1c5e-4508-a9d1-793e50835178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96673154-57d5-442a-93bf-5b490164e524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96673154-57d5-442a-93bf-5b490164e524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06b0f77d-d025-47e6-8363-5c30b3f9af2b', 'volume_name': 'volume-06b0f77d-d025-47e6-8363-5c30b3f9af2b', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85e376a-1085-4ab7-ab19-e19c158c5327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85e376a-1085-4ab7-ab19-e19c158c5327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ef779ba-ce44-4b02-a536-cf99baff2fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:41 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] Volume 06b0f77d-d025-47e6-8363-5c30b3f9af2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06b0f77d-d025-47e6-8363-5c30b3f9af2b', 'volume_size': 1}
Nov 05 09:36:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:36:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:36:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1151335430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b0f77d-d025-47e6-8363-5c30b3f9af2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c7c68d8754418c878eef0a77d523c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:36:42Z,use_quota=True,user_id='f8c3347ee1cd44de800ae8d54951deb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:36:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] Creating volume 06b0f77d-d025-47e6-8363-5c30b3f9af2b {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:36:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:36:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:36:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:36:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:36:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:36:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:36:41 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:36:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-06b0f77d-d025-47e6-8363-5c30b3f9af2b 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:41 devstack sudo[95141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-06b0f77d-d025-47e6-8363-5c30b3f9af2b 1073741824
Nov 05 09:36:41 devstack sudo[95141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:42 devstack sudo[95141]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-06b0f77d-d025-47e6-8363-5c30b3f9af2b 1073741824" returned: 0 in 0.430s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-06b0f77d-d025-47e6-8363-5c30b3f9af2b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:42 devstack sudo[95147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-06b0f77d-d025-47e6-8363-5c30b3f9af2b
Nov 05 09:36:42 devstack sudo[95147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:42 devstack sudo[95147]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-06b0f77d-d025-47e6-8363-5c30b3f9af2b" returned: 0 in 0.256s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:36:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:36:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ef779ba-ce44-4b02-a536-cf99baff2fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06b0f77d-d025-47e6-8363-5c30b3f9af2b', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (084e568f-cc91-4502-b832-9c5f06222556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:42 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] Volume volume-06b0f77d-d025-47e6-8363-5c30b3f9af2b (06b0f77d-d025-47e6-8363-5c30b3f9af2b): created successfully
Nov 05 09:36:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (084e568f-cc91-4502-b832-9c5f06222556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] Flow 'volume_create_manager' (f80b20bb-ea3a-4373-a231-e2c3b3ae58a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:36:42 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-1f1e5051-2770-4125-a87f-53697f788271 tempest-VolumesListAdminTestJSON-195497006 None] Created volume successfully.
Nov 05 09:36:43 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:36:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] Flow 'volume_create_manager' (8bda3681-7a51-43df-bcb8-81a5a5820c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:36:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (417977f3-0320-47f5-aafd-746af8afa862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (417977f3-0320-47f5-aafd-746af8afa862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-429415038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae17940c-ec0f-4da7-a2be-44d23ccb967c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c7c68d8754418c878eef0a77d523c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:36:43Z,use_quota=True,user_id='f8c3347ee1cd44de800ae8d54951deb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95f87b4-69bf-466d-b79d-9e2530f84c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95f87b4-69bf-466d-b79d-9e2530f84c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3900e849-47c4-4a1d-a9ea-4b9d7c646677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3900e849-47c4-4a1d-a9ea-4b9d7c646677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae17940c-ec0f-4da7-a2be-44d23ccb967c', 'volume_name': 'volume-ae17940c-ec0f-4da7-a2be-44d23ccb967c', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff14abe-367c-448a-b53e-f74187832b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff14abe-367c-448a-b53e-f74187832b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4669a1dc-0f64-43ad-9153-a9d0ebf9a09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:43 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] Volume ae17940c-ec0f-4da7-a2be-44d23ccb967c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae17940c-ec0f-4da7-a2be-44d23ccb967c', 'volume_size': 1}
Nov 05 09:36:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:36:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:36:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-429415038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae17940c-ec0f-4da7-a2be-44d23ccb967c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c7c68d8754418c878eef0a77d523c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:36:43Z,use_quota=True,user_id='f8c3347ee1cd44de800ae8d54951deb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:36:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] Creating volume ae17940c-ec0f-4da7-a2be-44d23ccb967c {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:36:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:36:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:36:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:36:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:36:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:36:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:36:43 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:36:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ae17940c-ec0f-4da7-a2be-44d23ccb967c 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:43 devstack sudo[95150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ae17940c-ec0f-4da7-a2be-44d23ccb967c 1073741824
Nov 05 09:36:43 devstack sudo[95150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:43 devstack sudo[95150]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ae17940c-ec0f-4da7-a2be-44d23ccb967c 1073741824" returned: 0 in 0.489s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ae17940c-ec0f-4da7-a2be-44d23ccb967c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:43 devstack sudo[95156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ae17940c-ec0f-4da7-a2be-44d23ccb967c
Nov 05 09:36:43 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:44 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ae17940c-ec0f-4da7-a2be-44d23ccb967c" returned: 0 in 0.266s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:36:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:36:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4669a1dc-0f64-43ad-9153-a9d0ebf9a09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae17940c-ec0f-4da7-a2be-44d23ccb967c', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff65352b-078c-46f2-9732-5be7af0abf4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:44 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] Volume volume-ae17940c-ec0f-4da7-a2be-44d23ccb967c (ae17940c-ec0f-4da7-a2be-44d23ccb967c): created successfully
Nov 05 09:36:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff65352b-078c-46f2-9732-5be7af0abf4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] Flow 'volume_create_manager' (8bda3681-7a51-43df-bcb8-81a5a5820c18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:36:44 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-667a4db0-fb94-405d-b1c9-c17a5b9d1b84 tempest-VolumesListAdminTestJSON-195497006 None] Created volume successfully.
Nov 05 09:36:46 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:36:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] Flow 'volume_create_manager' (1ea3de5a-a975-4c4a-b08d-bfdefa5dd004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:36:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed64073f-a80d-4db0-9d4f-c302df22aa58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed64073f-a80d-4db0-9d4f-c302df22aa58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91d1178f-f93d-4342-87cb-5e15ffb35d69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b0d87992344b27b6fed7ff8b3d7daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:36:46Z,use_quota=True,user_id='41fd2ada9ba747a592cbb3b161e91fbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d4217cc-8b9f-4311-9717-25eef0160ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d4217cc-8b9f-4311-9717-25eef0160ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7564aab8-e96d-4d88-ba46-2f00f4b82050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7564aab8-e96d-4d88-ba46-2f00f4b82050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91d1178f-f93d-4342-87cb-5e15ffb35d69', 'volume_name': 'volume-91d1178f-f93d-4342-87cb-5e15ffb35d69', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b455bfe0-4d22-458d-99c5-bcc6f698f377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b455bfe0-4d22-458d-99c5-bcc6f698f377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fafd6372-a01e-4138-8dbf-6561bf4a9de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:46 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] Volume 91d1178f-f93d-4342-87cb-5e15ffb35d69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91d1178f-f93d-4342-87cb-5e15ffb35d69', 'volume_size': 1}
Nov 05 09:36:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:36:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:36:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91d1178f-f93d-4342-87cb-5e15ffb35d69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b0d87992344b27b6fed7ff8b3d7daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:36:46Z,use_quota=True,user_id='41fd2ada9ba747a592cbb3b161e91fbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:36:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] Creating volume 91d1178f-f93d-4342-87cb-5e15ffb35d69 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:36:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:36:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:36:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:36:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:36:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:36:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:36:46 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:36:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-91d1178f-f93d-4342-87cb-5e15ffb35d69 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:46 devstack sudo[95159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-91d1178f-f93d-4342-87cb-5e15ffb35d69 1073741824
Nov 05 09:36:46 devstack sudo[95159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:46 devstack sudo[95159]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-91d1178f-f93d-4342-87cb-5e15ffb35d69 1073741824" returned: 0 in 0.492s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-91d1178f-f93d-4342-87cb-5e15ffb35d69 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:46 devstack sudo[95165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-91d1178f-f93d-4342-87cb-5e15ffb35d69
Nov 05 09:36:46 devstack sudo[95165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:47 devstack sudo[95165]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-91d1178f-f93d-4342-87cb-5e15ffb35d69" returned: 0 in 0.264s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:36:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:36:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fafd6372-a01e-4138-8dbf-6561bf4a9de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91d1178f-f93d-4342-87cb-5e15ffb35d69', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0513d2f-9175-4bc9-9ee7-a6d6e6dc3630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:47 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] Volume volume-91d1178f-f93d-4342-87cb-5e15ffb35d69 (91d1178f-f93d-4342-87cb-5e15ffb35d69): created successfully
Nov 05 09:36:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0513d2f-9175-4bc9-9ee7-a6d6e6dc3630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] Flow 'volume_create_manager' (1ea3de5a-a975-4c4a-b08d-bfdefa5dd004) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:36:47 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-17156ac9-b519-4066-8a69-fabb0197a00e tempest-VolumesListAdminTestJSON-279879758 None] Created volume successfully.
Nov 05 09:36:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ac638d55-b97c-46e1-a418-95c71e165673 tempest-VolumesListAdminTestJSON-279879758 None] Acquiring lock "cinder-91d1178f-f93d-4342-87cb-5e15ffb35d69-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:36:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ac638d55-b97c-46e1-a418-95c71e165673 tempest-VolumesListAdminTestJSON-279879758 None] Lock "cinder-91d1178f-f93d-4342-87cb-5e15ffb35d69-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:36:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ac638d55-b97c-46e1-a418-95c71e165673 tempest-VolumesListAdminTestJSON-279879758 None] Acquiring lock "cinder-quobyte-91d1178f-f93d-4342-87cb-5e15ffb35d69" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:36:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ac638d55-b97c-46e1-a418-95c71e165673 tempest-VolumesListAdminTestJSON-279879758 None] Lock "cinder-quobyte-91d1178f-f93d-4342-87cb-5e15ffb35d69" acquired by "delete_volume" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:36:48 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[da95ff2a-deb5-4c4c-89db-e3e43c3da484]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:36:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ac638d55-b97c-46e1-a418-95c71e165673 tempest-VolumesListAdminTestJSON-279879758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-91d1178f-f93d-4342-87cb-5e15ffb35d69 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d95c2590-35a1-49fe-95d1-48ce1bb80930 tempest-VolumesListAdminTestJSON-195497006 None] Acquiring lock "cinder-ae17940c-ec0f-4da7-a2be-44d23ccb967c-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:36:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d95c2590-35a1-49fe-95d1-48ce1bb80930 tempest-VolumesListAdminTestJSON-195497006 None] Lock "cinder-ae17940c-ec0f-4da7-a2be-44d23ccb967c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:36:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d95c2590-35a1-49fe-95d1-48ce1bb80930 tempest-VolumesListAdminTestJSON-195497006 None] Acquiring lock "cinder-quobyte-ae17940c-ec0f-4da7-a2be-44d23ccb967c" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:36:48 devstack sudo[95169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-91d1178f-f93d-4342-87cb-5e15ffb35d69
Nov 05 09:36:48 devstack sudo[95169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d95c2590-35a1-49fe-95d1-48ce1bb80930 tempest-VolumesListAdminTestJSON-195497006 None] Lock "cinder-quobyte-ae17940c-ec0f-4da7-a2be-44d23ccb967c" acquired by "delete_volume" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:36:48 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d0a891-6086-4d60-9d45-a5ad93df4acf]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:36:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d95c2590-35a1-49fe-95d1-48ce1bb80930 tempest-VolumesListAdminTestJSON-195497006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ae17940c-ec0f-4da7-a2be-44d23ccb967c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:48 devstack sudo[95171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ae17940c-ec0f-4da7-a2be-44d23ccb967c
Nov 05 09:36:48 devstack sudo[95171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:48 devstack sudo[95169]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ac638d55-b97c-46e1-a418-95c71e165673 tempest-VolumesListAdminTestJSON-279879758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-91d1178f-f93d-4342-87cb-5e15ffb35d69" returned: 0 in 0.395s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ac638d55-b97c-46e1-a418-95c71e165673 tempest-VolumesListAdminTestJSON-279879758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-91d1178f-f93d-4342-87cb-5e15ffb35d69 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:48 devstack sudo[95176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-91d1178f-f93d-4342-87cb-5e15ffb35d69
Nov 05 09:36:48 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:48 devstack sudo[95171]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d95c2590-35a1-49fe-95d1-48ce1bb80930 tempest-VolumesListAdminTestJSON-195497006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ae17940c-ec0f-4da7-a2be-44d23ccb967c" returned: 0 in 0.428s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d95c2590-35a1-49fe-95d1-48ce1bb80930 tempest-VolumesListAdminTestJSON-195497006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ae17940c-ec0f-4da7-a2be-44d23ccb967c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:48 devstack sudo[95182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ae17940c-ec0f-4da7-a2be-44d23ccb967c
Nov 05 09:36:48 devstack sudo[95182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:49 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ac638d55-b97c-46e1-a418-95c71e165673 tempest-VolumesListAdminTestJSON-279879758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-91d1178f-f93d-4342-87cb-5e15ffb35d69" returned: 0 in 0.309s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ac638d55-b97c-46e1-a418-95c71e165673 tempest-VolumesListAdminTestJSON-279879758 None] Lock "cinder-quobyte-91d1178f-f93d-4342-87cb-5e15ffb35d69" released by "delete_volume" :: held 0.757s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:36:49 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-ac638d55-b97c-46e1-a418-95c71e165673 tempest-VolumesListAdminTestJSON-279879758 None] Created reservations ['027c6db0-3920-42b9-bc29-c7c7019e5895', '91913313-7631-452b-88fe-9ab91026c3a8', '759a8766-5d62-476b-8e21-bcc5513b30e8', '82e8b54e-0cd7-42c8-b178-ddbb3cb0a6a2'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:36:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ac638d55-b97c-46e1-a418-95c71e165673 tempest-VolumesListAdminTestJSON-279879758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:36:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ac638d55-b97c-46e1-a418-95c71e165673 tempest-VolumesListAdminTestJSON-279879758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:36:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ac638d55-b97c-46e1-a418-95c71e165673 tempest-VolumesListAdminTestJSON-279879758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:36:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ac638d55-b97c-46e1-a418-95c71e165673 tempest-VolumesListAdminTestJSON-279879758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:36:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ac638d55-b97c-46e1-a418-95c71e165673 tempest-VolumesListAdminTestJSON-279879758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:36:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ac638d55-b97c-46e1-a418-95c71e165673 tempest-VolumesListAdminTestJSON-279879758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:49 devstack sudo[95182]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:49 devstack sudo[95187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:36:49 devstack sudo[95187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d95c2590-35a1-49fe-95d1-48ce1bb80930 tempest-VolumesListAdminTestJSON-195497006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ae17940c-ec0f-4da7-a2be-44d23ccb967c" returned: 0 in 0.360s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d95c2590-35a1-49fe-95d1-48ce1bb80930 tempest-VolumesListAdminTestJSON-195497006 None] Lock "cinder-quobyte-ae17940c-ec0f-4da7-a2be-44d23ccb967c" released by "delete_volume" :: held 0.850s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:36:49 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-d95c2590-35a1-49fe-95d1-48ce1bb80930 tempest-VolumesListAdminTestJSON-195497006 None] Created reservations ['1f1828a8-4228-4093-8cdf-d2ebd0bbbc7d', 'ed3de4bb-676c-4a8c-9c62-3078aae70941', '42696d74-4f49-41a2-a34a-d22f0f16f1e8', '2d09fc24-9d65-4434-a843-1353d12d9e12'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:36:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d95c2590-35a1-49fe-95d1-48ce1bb80930 tempest-VolumesListAdminTestJSON-195497006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:36:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d95c2590-35a1-49fe-95d1-48ce1bb80930 tempest-VolumesListAdminTestJSON-195497006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:36:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d95c2590-35a1-49fe-95d1-48ce1bb80930 tempest-VolumesListAdminTestJSON-195497006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:36:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d95c2590-35a1-49fe-95d1-48ce1bb80930 tempest-VolumesListAdminTestJSON-195497006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:36:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d95c2590-35a1-49fe-95d1-48ce1bb80930 tempest-VolumesListAdminTestJSON-195497006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:36:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d95c2590-35a1-49fe-95d1-48ce1bb80930 tempest-VolumesListAdminTestJSON-195497006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:49 devstack sudo[95189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:36:49 devstack sudo[95189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:49 devstack sudo[95187]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ac638d55-b97c-46e1-a418-95c71e165673 tempest-VolumesListAdminTestJSON-279879758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.349s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:49 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-ac638d55-b97c-46e1-a418-95c71e165673 tempest-VolumesListAdminTestJSON-279879758 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:36:49 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ac638d55-b97c-46e1-a418-95c71e165673 tempest-VolumesListAdminTestJSON-279879758 None] Deleted volume successfully.
Nov 05 09:36:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ac638d55-b97c-46e1-a418-95c71e165673 tempest-VolumesListAdminTestJSON-279879758 None] Lock "cinder-91d1178f-f93d-4342-87cb-5e15ffb35d69-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:36:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-982ea174-a003-4614-b42f-9a60531d0a1d tempest-VolumesListAdminTestJSON-195497006 None] Acquiring lock "cinder-06b0f77d-d025-47e6-8363-5c30b3f9af2b-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:36:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-982ea174-a003-4614-b42f-9a60531d0a1d tempest-VolumesListAdminTestJSON-195497006 None] Lock "cinder-06b0f77d-d025-47e6-8363-5c30b3f9af2b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:36:49 devstack sudo[95189]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d95c2590-35a1-49fe-95d1-48ce1bb80930 tempest-VolumesListAdminTestJSON-195497006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.304s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:49 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d95c2590-35a1-49fe-95d1-48ce1bb80930 tempest-VolumesListAdminTestJSON-195497006 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:36:49 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-d95c2590-35a1-49fe-95d1-48ce1bb80930 tempest-VolumesListAdminTestJSON-195497006 None] Deleted volume successfully.
Nov 05 09:36:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-982ea174-a003-4614-b42f-9a60531d0a1d tempest-VolumesListAdminTestJSON-195497006 None] Acquiring lock "cinder-quobyte-06b0f77d-d025-47e6-8363-5c30b3f9af2b" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:36:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d95c2590-35a1-49fe-95d1-48ce1bb80930 tempest-VolumesListAdminTestJSON-195497006 None] Lock "cinder-ae17940c-ec0f-4da7-a2be-44d23ccb967c-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:36:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-982ea174-a003-4614-b42f-9a60531d0a1d tempest-VolumesListAdminTestJSON-195497006 None] Lock "cinder-quobyte-06b0f77d-d025-47e6-8363-5c30b3f9af2b" acquired by "delete_volume" :: waited 0.030s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:36:49 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a038343-886e-430f-875a-e90bc1385a97]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:36:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-982ea174-a003-4614-b42f-9a60531d0a1d tempest-VolumesListAdminTestJSON-195497006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-06b0f77d-d025-47e6-8363-5c30b3f9af2b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:49 devstack sudo[95193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-06b0f77d-d025-47e6-8363-5c30b3f9af2b
Nov 05 09:36:49 devstack sudo[95193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:50 devstack sudo[95193]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-982ea174-a003-4614-b42f-9a60531d0a1d tempest-VolumesListAdminTestJSON-195497006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-06b0f77d-d025-47e6-8363-5c30b3f9af2b" returned: 0 in 0.381s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-982ea174-a003-4614-b42f-9a60531d0a1d tempest-VolumesListAdminTestJSON-195497006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-06b0f77d-d025-47e6-8363-5c30b3f9af2b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:50 devstack sudo[95198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-06b0f77d-d025-47e6-8363-5c30b3f9af2b
Nov 05 09:36:50 devstack sudo[95198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:50 devstack sudo[95198]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-982ea174-a003-4614-b42f-9a60531d0a1d tempest-VolumesListAdminTestJSON-195497006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-06b0f77d-d025-47e6-8363-5c30b3f9af2b" returned: 0 in 0.246s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-982ea174-a003-4614-b42f-9a60531d0a1d tempest-VolumesListAdminTestJSON-195497006 None] Lock "cinder-quobyte-06b0f77d-d025-47e6-8363-5c30b3f9af2b" released by "delete_volume" :: held 0.679s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:36:50 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-982ea174-a003-4614-b42f-9a60531d0a1d tempest-VolumesListAdminTestJSON-195497006 None] Created reservations ['aef6ba7c-0bac-4525-8e90-700340c9496a', '99cd0520-3389-4ed4-9a47-14daab7ea299', 'e30eae6a-0fcd-4065-b366-d1dbb544f80d', 'ff68502f-eba1-463c-b89e-0865d26566c9'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:36:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-982ea174-a003-4614-b42f-9a60531d0a1d tempest-VolumesListAdminTestJSON-195497006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:36:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-982ea174-a003-4614-b42f-9a60531d0a1d tempest-VolumesListAdminTestJSON-195497006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:36:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-982ea174-a003-4614-b42f-9a60531d0a1d tempest-VolumesListAdminTestJSON-195497006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:36:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-982ea174-a003-4614-b42f-9a60531d0a1d tempest-VolumesListAdminTestJSON-195497006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:36:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-982ea174-a003-4614-b42f-9a60531d0a1d tempest-VolumesListAdminTestJSON-195497006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:36:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-982ea174-a003-4614-b42f-9a60531d0a1d tempest-VolumesListAdminTestJSON-195497006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:50 devstack sudo[95201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:36:50 devstack sudo[95201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:50 devstack sudo[95201]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-982ea174-a003-4614-b42f-9a60531d0a1d tempest-VolumesListAdminTestJSON-195497006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.302s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:50 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-982ea174-a003-4614-b42f-9a60531d0a1d tempest-VolumesListAdminTestJSON-195497006 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:36:50 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-982ea174-a003-4614-b42f-9a60531d0a1d tempest-VolumesListAdminTestJSON-195497006 None] Deleted volume successfully.
Nov 05 09:36:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-982ea174-a003-4614-b42f-9a60531d0a1d tempest-VolumesListAdminTestJSON-195497006 None] Lock "cinder-06b0f77d-d025-47e6-8363-5c30b3f9af2b-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:36:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-736fa058-53ab-43a9-a1b5-d44b23f3fdb3 tempest-VolumesListAdminTestJSON-195497006 None] Acquiring lock "cinder-525611c1-9140-478f-b6b9-a09f0991c1bc-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:36:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-736fa058-53ab-43a9-a1b5-d44b23f3fdb3 tempest-VolumesListAdminTestJSON-195497006 None] Lock "cinder-525611c1-9140-478f-b6b9-a09f0991c1bc-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:36:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-736fa058-53ab-43a9-a1b5-d44b23f3fdb3 tempest-VolumesListAdminTestJSON-195497006 None] Acquiring lock "cinder-quobyte-525611c1-9140-478f-b6b9-a09f0991c1bc" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:36:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-736fa058-53ab-43a9-a1b5-d44b23f3fdb3 tempest-VolumesListAdminTestJSON-195497006 None] Lock "cinder-quobyte-525611c1-9140-478f-b6b9-a09f0991c1bc" acquired by "delete_volume" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:36:51 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a3a112-7aa5-4017-87da-cec314ca18f3]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:36:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-736fa058-53ab-43a9-a1b5-d44b23f3fdb3 tempest-VolumesListAdminTestJSON-195497006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-525611c1-9140-478f-b6b9-a09f0991c1bc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:51 devstack sudo[95204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-525611c1-9140-478f-b6b9-a09f0991c1bc
Nov 05 09:36:51 devstack sudo[95204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:51 devstack sudo[95204]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-736fa058-53ab-43a9-a1b5-d44b23f3fdb3 tempest-VolumesListAdminTestJSON-195497006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-525611c1-9140-478f-b6b9-a09f0991c1bc" returned: 0 in 0.394s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-736fa058-53ab-43a9-a1b5-d44b23f3fdb3 tempest-VolumesListAdminTestJSON-195497006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-525611c1-9140-478f-b6b9-a09f0991c1bc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:51 devstack sudo[95209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-525611c1-9140-478f-b6b9-a09f0991c1bc
Nov 05 09:36:51 devstack sudo[95209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:51 devstack sudo[95209]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-736fa058-53ab-43a9-a1b5-d44b23f3fdb3 tempest-VolumesListAdminTestJSON-195497006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-525611c1-9140-478f-b6b9-a09f0991c1bc" returned: 0 in 0.263s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-736fa058-53ab-43a9-a1b5-d44b23f3fdb3 tempest-VolumesListAdminTestJSON-195497006 None] Lock "cinder-quobyte-525611c1-9140-478f-b6b9-a09f0991c1bc" released by "delete_volume" :: held 0.700s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:36:51 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-736fa058-53ab-43a9-a1b5-d44b23f3fdb3 tempest-VolumesListAdminTestJSON-195497006 None] Created reservations ['efd8001b-a2a4-45c8-8fc7-3dd2a3541645', '17b27d03-09d5-4e92-b1e1-b712f058f823', '9d72678b-93e4-418e-a866-659be5440dcf', 'c650fb7c-e86e-453c-a20b-4f78bd0e2ea3'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:36:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-736fa058-53ab-43a9-a1b5-d44b23f3fdb3 tempest-VolumesListAdminTestJSON-195497006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:36:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-736fa058-53ab-43a9-a1b5-d44b23f3fdb3 tempest-VolumesListAdminTestJSON-195497006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:36:51 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-736fa058-53ab-43a9-a1b5-d44b23f3fdb3 tempest-VolumesListAdminTestJSON-195497006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:36:51 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-736fa058-53ab-43a9-a1b5-d44b23f3fdb3 tempest-VolumesListAdminTestJSON-195497006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:36:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-736fa058-53ab-43a9-a1b5-d44b23f3fdb3 tempest-VolumesListAdminTestJSON-195497006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:36:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-736fa058-53ab-43a9-a1b5-d44b23f3fdb3 tempest-VolumesListAdminTestJSON-195497006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:51 devstack sudo[95212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:36:51 devstack sudo[95212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:52 devstack sudo[95212]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-736fa058-53ab-43a9-a1b5-d44b23f3fdb3 tempest-VolumesListAdminTestJSON-195497006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.284s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:52 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-736fa058-53ab-43a9-a1b5-d44b23f3fdb3 tempest-VolumesListAdminTestJSON-195497006 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:36:52 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-736fa058-53ab-43a9-a1b5-d44b23f3fdb3 tempest-VolumesListAdminTestJSON-195497006 None] Deleted volume successfully.
Nov 05 09:36:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-736fa058-53ab-43a9-a1b5-d44b23f3fdb3 tempest-VolumesListAdminTestJSON-195497006 None] Lock "cinder-525611c1-9140-478f-b6b9-a09f0991c1bc-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:36:57 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:36:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] Flow 'volume_create_manager' (a6d160a1-ac2b-4910-adf4-21d0cec44d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:36:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (167d2a0b-7639-4a79-802a-726ec05cff25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (167d2a0b-7639-4a79-802a-726ec05cff25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1647818230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8bcada6-f582-41bf-92c7-a1362e3a3b82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f6504c8ee6744619416fe636f177ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:36:57Z,use_quota=True,user_id='4a8b7f937097402591eae4888c6ae753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5d5312f-0fd2-4122-a5b5-1c8d7a10d0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5d5312f-0fd2-4122-a5b5-1c8d7a10d0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40df0b87-0cbd-47c9-8bda-dcaec149ba9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40df0b87-0cbd-47c9-8bda-dcaec149ba9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8bcada6-f582-41bf-92c7-a1362e3a3b82', 'volume_name': 'volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caa51914-1a73-47e2-9a80-410a21da6ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caa51914-1a73-47e2-9a80-410a21da6ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b4ae7c-9b4a-44c5-80bb-72f6fd98fe85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:57 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] Volume e8bcada6-f582-41bf-92c7-a1362e3a3b82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82', 'volume_size': 1}
Nov 05 09:36:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:36:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:36:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1647818230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8bcada6-f582-41bf-92c7-a1362e3a3b82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f6504c8ee6744619416fe636f177ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:36:57Z,use_quota=True,user_id='4a8b7f937097402591eae4888c6ae753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:36:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] Creating volume e8bcada6-f582-41bf-92c7-a1362e3a3b82 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:36:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:36:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:36:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:36:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:36:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:36:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:36:57 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:36:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:57 devstack sudo[95215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82 1073741824
Nov 05 09:36:57 devstack sudo[95215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:57 devstack sudo[95215]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82 1073741824" returned: 0 in 0.433s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:57 devstack sudo[95221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82
Nov 05 09:36:57 devstack sudo[95221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:58 devstack sudo[95221]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82" returned: 0 in 0.288s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:36:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:36:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b4ae7c-9b4a-44c5-80bb-72f6fd98fe85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c573bdf-5d9e-4ca7-abf8-ec84b081964d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:36:58 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] Volume volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82 (e8bcada6-f582-41bf-92c7-a1362e3a3b82): created successfully
Nov 05 09:36:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c573bdf-5d9e-4ca7-abf8-ec84b081964d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:36:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] Flow 'volume_create_manager' (a6d160a1-ac2b-4910-adf4-21d0cec44d40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:36:58 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-8b97c748-9fe6-4503-ac6c-558aa1a00b15 tempest-SnapshotMetadataTestJSON-1460120417 None] Created volume successfully.
Nov 05 09:36:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-91a1dd32-f0c0-4223-93dd-56739be4bc8d tempest-SnapshotMetadataTestJSON-1460120417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:36:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-91a1dd32-f0c0-4223-93dd-56739be4bc8d tempest-SnapshotMetadataTestJSON-1460120417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:36:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-91a1dd32-f0c0-4223-93dd-56739be4bc8d tempest-SnapshotMetadataTestJSON-1460120417 None] Creating offline snapshot db72c7cc-0cf5-40fe-b751-64fb6da8d05a of volume e8bcada6-f582-41bf-92c7-a1362e3a3b82 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 09:36:58 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb98e961-c932-491b-badf-2ef0e82f529f]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:36:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-91a1dd32-f0c0-4223-93dd-56739be4bc8d tempest-SnapshotMetadataTestJSON-1460120417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:58 devstack sudo[95224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82
Nov 05 09:36:58 devstack sudo[95224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:58 devstack sudo[95224]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-91a1dd32-f0c0-4223-93dd-56739be4bc8d tempest-SnapshotMetadataTestJSON-1460120417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82" returned: 0 in 0.390s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-91a1dd32-f0c0-4223-93dd-56739be4bc8d tempest-SnapshotMetadataTestJSON-1460120417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82.db72c7cc-0cf5-40fe-b751-64fb6da8d05a 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:58 devstack sudo[95230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82.db72c7cc-0cf5-40fe-b751-64fb6da8d05a 1G
Nov 05 09:36:58 devstack sudo[95230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:59 devstack sudo[95230]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-91a1dd32-f0c0-4223-93dd-56739be4bc8d tempest-SnapshotMetadataTestJSON-1460120417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82.db72c7cc-0cf5-40fe-b751-64fb6da8d05a 1G" returned: 0 in 0.478s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-91a1dd32-f0c0-4223-93dd-56739be4bc8d tempest-SnapshotMetadataTestJSON-1460120417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82.db72c7cc-0cf5-40fe-b751-64fb6da8d05a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:59 devstack sudo[95236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82.db72c7cc-0cf5-40fe-b751-64fb6da8d05a
Nov 05 09:36:59 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:36:59 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root
Nov 05 09:36:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-91a1dd32-f0c0-4223-93dd-56739be4bc8d tempest-SnapshotMetadataTestJSON-1460120417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82.db72c7cc-0cf5-40fe-b751-64fb6da8d05a" returned: 0 in 0.346s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:36:59 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-91a1dd32-f0c0-4223-93dd-56739be4bc8d tempest-SnapshotMetadataTestJSON-1460120417 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82.db72c7cc-0cf5-40fe-b751-64fb6da8d05a is being set with open permissions: ugo+rw
Nov 05 09:36:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-91a1dd32-f0c0-4223-93dd-56739be4bc8d tempest-SnapshotMetadataTestJSON-1460120417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82.db72c7cc-0cf5-40fe-b751-64fb6da8d05a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:36:59 devstack sudo[95241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82.db72c7cc-0cf5-40fe-b751-64fb6da8d05a
Nov 05 09:36:59 devstack sudo[95241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:00 devstack sudo[95241]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-91a1dd32-f0c0-4223-93dd-56739be4bc8d tempest-SnapshotMetadataTestJSON-1460120417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82.db72c7cc-0cf5-40fe-b751-64fb6da8d05a" returned: 0 in 0.256s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-91a1dd32-f0c0-4223-93dd-56739be4bc8d tempest-SnapshotMetadataTestJSON-1460120417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:00 devstack sudo[95244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82.info
Nov 05 09:37:00 devstack sudo[95244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:37:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:37:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:37:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:37:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:37:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:37:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:00 devstack sudo[95246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:37:00 devstack sudo[95246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:00 devstack sudo[95244]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-91a1dd32-f0c0-4223-93dd-56739be4bc8d tempest-SnapshotMetadataTestJSON-1460120417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82.info" returned: 0 in 0.249s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:00 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-91a1dd32-f0c0-4223-93dd-56739be4bc8d tempest-SnapshotMetadataTestJSON-1460120417 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82.info is being set with open permissions: ugo+rw
Nov 05 09:37:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-91a1dd32-f0c0-4223-93dd-56739be4bc8d tempest-SnapshotMetadataTestJSON-1460120417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:00 devstack sudo[95249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82.info
Nov 05 09:37:00 devstack sudo[95249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:00 devstack sudo[95246]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.257s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:37:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:37:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 28 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:37:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>, <Thread(tpool_thread_0, started daemon 132223357408960)>, <Thread(tpool_thread_1, started daemon 132223349016256)>, <Thread(tpool_thread_2, started daemon 132223340623552)>, <Thread(tpool_thread_3, started daemon 132223332230848)>, <Thread(tpool_thread_4, started daemon 132223323838144)>, <Thread(tpool_thread_5, started daemon 132223315445440)>, <Thread(tpool_thread_6, started daemon 132223307052736)>, <Thread(tpool_thread_7, started daemon 132223298660032)>, <Thread(tpool_thread_8, started daemon 132223290250944)>, <Thread(tpool_thread_9, started daemon 132223281841856)>, <Thread(tpool_thread_10, started daemon 132223273432768)>, <Thread(tpool_thread_11, started daemon 132223265023680)>, <Thread(tpool_thread_12, started daemon 132223256614592)>, <Thread(tpool_thread_13, started daemon 132223248205504)>, <Thread(tpool_thread_14, started daemon 132223239796416)>, <Thread(tpool_thread_15, started daemon 132223231387328)>, <Thread(tpool_thread_16, started daemon 132223222978240)>, <Thread(tpool_thread_17, started daemon 132223214569152)>, <Thread(tpool_thread_18, started daemon 132223206160064)>, <Thread(tpool_thread_19, started daemon 132223197750976)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:37:00 devstack sudo[95249]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-91a1dd32-f0c0-4223-93dd-56739be4bc8d tempest-SnapshotMetadataTestJSON-1460120417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82.info" returned: 0 in 0.293s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-91a1dd32-f0c0-4223-93dd-56739be4bc8d tempest-SnapshotMetadataTestJSON-1460120417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.114s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:37:00 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-91a1dd32-f0c0-4223-93dd-56739be4bc8d tempest-SnapshotMetadataTestJSON-1460120417 None] Create snapshot completed successfully
Nov 05 09:37:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0a0dfde2-8dc5-4ab6-8b25-3c39625fd6f8 tempest-SnapshotMetadataTestJSON-1460120417 None] Acquiring lock "cinder-db72c7cc-0cf5-40fe-b751-64fb6da8d05a-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:37:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0a0dfde2-8dc5-4ab6-8b25-3c39625fd6f8 tempest-SnapshotMetadataTestJSON-1460120417 None] Lock "cinder-db72c7cc-0cf5-40fe-b751-64fb6da8d05a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:37:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0a0dfde2-8dc5-4ab6-8b25-3c39625fd6f8 tempest-SnapshotMetadataTestJSON-1460120417 None] Acquiring lock "cinder-quobyte-e8bcada6-f582-41bf-92c7-a1362e3a3b82" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:37:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0a0dfde2-8dc5-4ab6-8b25-3c39625fd6f8 tempest-SnapshotMetadataTestJSON-1460120417 None] Lock "cinder-quobyte-e8bcada6-f582-41bf-92c7-a1362e3a3b82" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:37:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0a0dfde2-8dc5-4ab6-8b25-3c39625fd6f8 tempest-SnapshotMetadataTestJSON-1460120417 None] Acquiring lock "cinder-quobyte-db72c7cc-0cf5-40fe-b751-64fb6da8d05a" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:37:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0a0dfde2-8dc5-4ab6-8b25-3c39625fd6f8 tempest-SnapshotMetadataTestJSON-1460120417 None] Lock "cinder-quobyte-db72c7cc-0cf5-40fe-b751-64fb6da8d05a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:37:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-0a0dfde2-8dc5-4ab6-8b25-3c39625fd6f8 tempest-SnapshotMetadataTestJSON-1460120417 None] Deleting offline snapshot db72c7cc-0cf5-40fe-b751-64fb6da8d05a of volume e8bcada6-f582-41bf-92c7-a1362e3a3b82 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 09:37:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-0a0dfde2-8dc5-4ab6-8b25-3c39625fd6f8 tempest-SnapshotMetadataTestJSON-1460120417 None] snapshot_file for this snap is: volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82.db72c7cc-0cf5-40fe-b751-64fb6da8d05a {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 09:37:02 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[0279d53e-e0a7-4abc-a026-b09b000de5ad]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:37:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0a0dfde2-8dc5-4ab6-8b25-3c39625fd6f8 tempest-SnapshotMetadataTestJSON-1460120417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82.db72c7cc-0cf5-40fe-b751-64fb6da8d05a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:02 devstack sudo[95260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82.db72c7cc-0cf5-40fe-b751-64fb6da8d05a
Nov 05 09:37:02 devstack sudo[95260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:02 devstack sudo[95260]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0a0dfde2-8dc5-4ab6-8b25-3c39625fd6f8 tempest-SnapshotMetadataTestJSON-1460120417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82.db72c7cc-0cf5-40fe-b751-64fb6da8d05a" returned: 0 in 0.377s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-0a0dfde2-8dc5-4ab6-8b25-3c39625fd6f8 tempest-SnapshotMetadataTestJSON-1460120417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:37:03 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f9b30d-8247-4ab9-81be-4dfe25f79025]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:37:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0a0dfde2-8dc5-4ab6-8b25-3c39625fd6f8 tempest-SnapshotMetadataTestJSON-1460120417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:03 devstack sudo[95274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82
Nov 05 09:37:03 devstack sudo[95274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:03 devstack sudo[95274]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0a0dfde2-8dc5-4ab6-8b25-3c39625fd6f8 tempest-SnapshotMetadataTestJSON-1460120417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82" returned: 0 in 0.404s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0a0dfde2-8dc5-4ab6-8b25-3c39625fd6f8 tempest-SnapshotMetadataTestJSON-1460120417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82.db72c7cc-0cf5-40fe-b751-64fb6da8d05a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:03 devstack sudo[95288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82.db72c7cc-0cf5-40fe-b751-64fb6da8d05a
Nov 05 09:37:03 devstack sudo[95288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:03 devstack sudo[95288]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0a0dfde2-8dc5-4ab6-8b25-3c39625fd6f8 tempest-SnapshotMetadataTestJSON-1460120417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82.db72c7cc-0cf5-40fe-b751-64fb6da8d05a" returned: 0 in 0.439s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0a0dfde2-8dc5-4ab6-8b25-3c39625fd6f8 tempest-SnapshotMetadataTestJSON-1460120417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82.db72c7cc-0cf5-40fe-b751-64fb6da8d05a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:03 devstack sudo[95294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82.db72c7cc-0cf5-40fe-b751-64fb6da8d05a
Nov 05 09:37:03 devstack sudo[95294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:04 devstack sudo[95294]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0a0dfde2-8dc5-4ab6-8b25-3c39625fd6f8 tempest-SnapshotMetadataTestJSON-1460120417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82.db72c7cc-0cf5-40fe-b751-64fb6da8d05a" returned: 0 in 0.259s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0a0dfde2-8dc5-4ab6-8b25-3c39625fd6f8 tempest-SnapshotMetadataTestJSON-1460120417 None] Lock "cinder-quobyte-db72c7cc-0cf5-40fe-b751-64fb6da8d05a" released by "_delete_snapshot" :: held 1.599s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:37:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0a0dfde2-8dc5-4ab6-8b25-3c39625fd6f8 tempest-SnapshotMetadataTestJSON-1460120417 None] Lock "cinder-quobyte-e8bcada6-f582-41bf-92c7-a1362e3a3b82" released by "delete_snapshot" :: held 1.623s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:37:04 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-0a0dfde2-8dc5-4ab6-8b25-3c39625fd6f8 tempest-SnapshotMetadataTestJSON-1460120417 None] Created reservations ['3a8caa81-5bd7-40bd-94fb-bcaa773df6dd', '3a813929-9a6f-4d71-aa89-8800e1e20ccc', '00fccef4-8125-4dba-97a8-b7c463e6e0bf', '247cf231-d2cd-4855-bc53-c427f90d862a'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:37:04 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-0a0dfde2-8dc5-4ab6-8b25-3c39625fd6f8 tempest-SnapshotMetadataTestJSON-1460120417 None] Delete snapshot completed successfully.
Nov 05 09:37:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0a0dfde2-8dc5-4ab6-8b25-3c39625fd6f8 tempest-SnapshotMetadataTestJSON-1460120417 None] Lock "cinder-db72c7cc-0cf5-40fe-b751-64fb6da8d05a-delete_snapshot" released by "delete_snapshot" :: held 1.760s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:37:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b24221f5-a547-4a95-94e9-4b47c424747c tempest-SnapshotMetadataTestJSON-1460120417 None] Acquiring lock "cinder-e8bcada6-f582-41bf-92c7-a1362e3a3b82-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:37:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b24221f5-a547-4a95-94e9-4b47c424747c tempest-SnapshotMetadataTestJSON-1460120417 None] Lock "cinder-e8bcada6-f582-41bf-92c7-a1362e3a3b82-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:37:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b24221f5-a547-4a95-94e9-4b47c424747c tempest-SnapshotMetadataTestJSON-1460120417 None] Acquiring lock "cinder-quobyte-e8bcada6-f582-41bf-92c7-a1362e3a3b82" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:37:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b24221f5-a547-4a95-94e9-4b47c424747c tempest-SnapshotMetadataTestJSON-1460120417 None] Lock "cinder-quobyte-e8bcada6-f582-41bf-92c7-a1362e3a3b82" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:37:04 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f89f39-21b7-4862-9afb-f64016e79f53]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:37:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b24221f5-a547-4a95-94e9-4b47c424747c tempest-SnapshotMetadataTestJSON-1460120417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:05 devstack sudo[95297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82
Nov 05 09:37:05 devstack sudo[95297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:05 devstack sudo[95297]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b24221f5-a547-4a95-94e9-4b47c424747c tempest-SnapshotMetadataTestJSON-1460120417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82" returned: 0 in 0.365s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b24221f5-a547-4a95-94e9-4b47c424747c tempest-SnapshotMetadataTestJSON-1460120417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:05 devstack sudo[95302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82
Nov 05 09:37:05 devstack sudo[95302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:05 devstack sudo[95302]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b24221f5-a547-4a95-94e9-4b47c424747c tempest-SnapshotMetadataTestJSON-1460120417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e8bcada6-f582-41bf-92c7-a1362e3a3b82" returned: 0 in 0.246s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b24221f5-a547-4a95-94e9-4b47c424747c tempest-SnapshotMetadataTestJSON-1460120417 None] Lock "cinder-quobyte-e8bcada6-f582-41bf-92c7-a1362e3a3b82" released by "delete_volume" :: held 0.699s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:37:05 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-b24221f5-a547-4a95-94e9-4b47c424747c tempest-SnapshotMetadataTestJSON-1460120417 None] Created reservations ['36488d94-7c20-484a-8ded-1113fcb88b70', '104e3f16-b614-480b-b81c-7b75ff39cae2', '88b5ea75-b095-493b-8096-0f43c75ef2e2', 'fb4b7b3c-1424-43d4-a441-bea2af73aaae'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:37:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b24221f5-a547-4a95-94e9-4b47c424747c tempest-SnapshotMetadataTestJSON-1460120417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:37:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b24221f5-a547-4a95-94e9-4b47c424747c tempest-SnapshotMetadataTestJSON-1460120417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:37:05 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b24221f5-a547-4a95-94e9-4b47c424747c tempest-SnapshotMetadataTestJSON-1460120417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:37:05 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b24221f5-a547-4a95-94e9-4b47c424747c tempest-SnapshotMetadataTestJSON-1460120417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:37:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b24221f5-a547-4a95-94e9-4b47c424747c tempest-SnapshotMetadataTestJSON-1460120417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:37:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b24221f5-a547-4a95-94e9-4b47c424747c tempest-SnapshotMetadataTestJSON-1460120417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:05 devstack sudo[95305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:37:05 devstack sudo[95305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:05 devstack sudo[95305]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b24221f5-a547-4a95-94e9-4b47c424747c tempest-SnapshotMetadataTestJSON-1460120417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.286s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:05 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-b24221f5-a547-4a95-94e9-4b47c424747c tempest-SnapshotMetadataTestJSON-1460120417 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:37:05 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b24221f5-a547-4a95-94e9-4b47c424747c tempest-SnapshotMetadataTestJSON-1460120417 None] Deleted volume successfully.
Nov 05 09:37:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b24221f5-a547-4a95-94e9-4b47c424747c tempest-SnapshotMetadataTestJSON-1460120417 None] Lock "cinder-e8bcada6-f582-41bf-92c7-a1362e3a3b82-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:37:10 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:37:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] Flow 'volume_create_manager' (a2778ac2-86e4-49e3-8504-1dafd47cf34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:37:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90641755-ade9-4660-a254-7984f62f421a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90641755-ade9-4660-a254-7984f62f421a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-893709715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ccdfef-bf51-4662-b382-d99832da9bcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a78f39d8ec09463b9271780ad9dbbf44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:37:10Z,use_quota=True,user_id='8b053d165b394a15a13060056f005556',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef94edd4-e92c-45e9-8e5a-400b9a5e4662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef94edd4-e92c-45e9-8e5a-400b9a5e4662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99a8077-a9bf-4748-96a5-c325d1e9f5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99a8077-a9bf-4748-96a5-c325d1e9f5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04ccdfef-bf51-4662-b382-d99832da9bcb', 'volume_name': 'volume-04ccdfef-bf51-4662-b382-d99832da9bcb', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60e9efd2-d2e7-4ae7-800c-ea766098e34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60e9efd2-d2e7-4ae7-800c-ea766098e34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c929956d-10c2-4a69-b358-99f3f381b578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:10 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] Volume 04ccdfef-bf51-4662-b382-d99832da9bcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04ccdfef-bf51-4662-b382-d99832da9bcb', 'volume_size': 1}
Nov 05 09:37:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:37:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:37:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-893709715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ccdfef-bf51-4662-b382-d99832da9bcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a78f39d8ec09463b9271780ad9dbbf44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:37:10Z,use_quota=True,user_id='8b053d165b394a15a13060056f005556',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:37:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] Creating volume 04ccdfef-bf51-4662-b382-d99832da9bcb {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:37:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:37:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:37:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:37:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:37:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:37:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:37:10 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:37:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-04ccdfef-bf51-4662-b382-d99832da9bcb 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:10 devstack sudo[95310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-04ccdfef-bf51-4662-b382-d99832da9bcb 1073741824
Nov 05 09:37:10 devstack sudo[95310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:11 devstack sudo[95310]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-04ccdfef-bf51-4662-b382-d99832da9bcb 1073741824" returned: 0 in 0.421s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-04ccdfef-bf51-4662-b382-d99832da9bcb {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:11 devstack sudo[95315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-04ccdfef-bf51-4662-b382-d99832da9bcb
Nov 05 09:37:11 devstack sudo[95315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:11 devstack sudo[95315]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-04ccdfef-bf51-4662-b382-d99832da9bcb" returned: 0 in 0.248s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:11 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:37:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:37:11 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c929956d-10c2-4a69-b358-99f3f381b578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04ccdfef-bf51-4662-b382-d99832da9bcb', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:11 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a6c439-e86d-4450-ac07-f133bdc15e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:11 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] Volume volume-04ccdfef-bf51-4662-b382-d99832da9bcb (04ccdfef-bf51-4662-b382-d99832da9bcb): created successfully
Nov 05 09:37:11 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a6c439-e86d-4450-ac07-f133bdc15e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:11 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] Flow 'volume_create_manager' (a2778ac2-86e4-49e3-8504-1dafd47cf34a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:37:11 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-758ae921-692f-4706-ab3e-df3bfaeec03a tempest-AbsoluteLimitsTests-1118648499 None] Created volume successfully.
Nov 05 09:37:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b2ad84f3-04d6-4133-9cf2-b0eb16b9f536 tempest-AbsoluteLimitsTests-1118648499 None] Acquiring lock "cinder-04ccdfef-bf51-4662-b382-d99832da9bcb-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:37:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b2ad84f3-04d6-4133-9cf2-b0eb16b9f536 tempest-AbsoluteLimitsTests-1118648499 None] Lock "cinder-04ccdfef-bf51-4662-b382-d99832da9bcb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:37:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b2ad84f3-04d6-4133-9cf2-b0eb16b9f536 tempest-AbsoluteLimitsTests-1118648499 None] Acquiring lock "cinder-quobyte-04ccdfef-bf51-4662-b382-d99832da9bcb" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:37:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b2ad84f3-04d6-4133-9cf2-b0eb16b9f536 tempest-AbsoluteLimitsTests-1118648499 None] Lock "cinder-quobyte-04ccdfef-bf51-4662-b382-d99832da9bcb" acquired by "delete_volume" :: waited 0.029s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:37:11 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e5be1e-477e-4b1f-b07d-17fc29942c37]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:37:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b2ad84f3-04d6-4133-9cf2-b0eb16b9f536 tempest-AbsoluteLimitsTests-1118648499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-04ccdfef-bf51-4662-b382-d99832da9bcb {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:11 devstack sudo[95318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-04ccdfef-bf51-4662-b382-d99832da9bcb
Nov 05 09:37:11 devstack sudo[95318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:12 devstack sudo[95318]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b2ad84f3-04d6-4133-9cf2-b0eb16b9f536 tempest-AbsoluteLimitsTests-1118648499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-04ccdfef-bf51-4662-b382-d99832da9bcb" returned: 0 in 0.352s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b2ad84f3-04d6-4133-9cf2-b0eb16b9f536 tempest-AbsoluteLimitsTests-1118648499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-04ccdfef-bf51-4662-b382-d99832da9bcb {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:12 devstack sudo[95323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-04ccdfef-bf51-4662-b382-d99832da9bcb
Nov 05 09:37:12 devstack sudo[95323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:12 devstack sudo[95323]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b2ad84f3-04d6-4133-9cf2-b0eb16b9f536 tempest-AbsoluteLimitsTests-1118648499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-04ccdfef-bf51-4662-b382-d99832da9bcb" returned: 0 in 0.250s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b2ad84f3-04d6-4133-9cf2-b0eb16b9f536 tempest-AbsoluteLimitsTests-1118648499 None] Lock "cinder-quobyte-04ccdfef-bf51-4662-b382-d99832da9bcb" released by "delete_volume" :: held 0.656s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:37:12 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-b2ad84f3-04d6-4133-9cf2-b0eb16b9f536 tempest-AbsoluteLimitsTests-1118648499 None] Created reservations ['678e219a-3d17-4340-9e95-93515ac95382', '0f3ca1df-27ae-48c4-8b79-204186263b3d', '6603dda1-b045-4aca-a0a6-2a90f784e0ba', '8e33fe5c-5176-42a0-b55b-fa0d5937e54e'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:37:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b2ad84f3-04d6-4133-9cf2-b0eb16b9f536 tempest-AbsoluteLimitsTests-1118648499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:37:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b2ad84f3-04d6-4133-9cf2-b0eb16b9f536 tempest-AbsoluteLimitsTests-1118648499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:37:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b2ad84f3-04d6-4133-9cf2-b0eb16b9f536 tempest-AbsoluteLimitsTests-1118648499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:37:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b2ad84f3-04d6-4133-9cf2-b0eb16b9f536 tempest-AbsoluteLimitsTests-1118648499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:37:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b2ad84f3-04d6-4133-9cf2-b0eb16b9f536 tempest-AbsoluteLimitsTests-1118648499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:37:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b2ad84f3-04d6-4133-9cf2-b0eb16b9f536 tempest-AbsoluteLimitsTests-1118648499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:12 devstack sudo[95326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:37:12 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:12 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b2ad84f3-04d6-4133-9cf2-b0eb16b9f536 tempest-AbsoluteLimitsTests-1118648499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.268s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:12 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-b2ad84f3-04d6-4133-9cf2-b0eb16b9f536 tempest-AbsoluteLimitsTests-1118648499 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:37:12 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b2ad84f3-04d6-4133-9cf2-b0eb16b9f536 tempest-AbsoluteLimitsTests-1118648499 None] Deleted volume successfully.
Nov 05 09:37:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b2ad84f3-04d6-4133-9cf2-b0eb16b9f536 tempest-AbsoluteLimitsTests-1118648499 None] Lock "cinder-04ccdfef-bf51-4662-b382-d99832da9bcb-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:37:19 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:37:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] Flow 'volume_create_manager' (b1b30cfc-b608-4697-98c9-4d5b2681c9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:37:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33c3964c-b127-4c8e-ad7c-2d733e82a55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33c3964c-b127-4c8e-ad7c-2d733e82a55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1537838672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57cafbb3-4c3b-45c6-917d-64e94f36336e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df24e15bf71049f3b3ffe36007444444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:37:19Z,use_quota=True,user_id='26647e20a69d478a80c45c37332b5b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27c251e3-5b30-4c28-8828-18840871b978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27c251e3-5b30-4c28-8828-18840871b978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88e1803-0d53-4be2-ba61-63b7841a3f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88e1803-0d53-4be2-ba61-63b7841a3f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57cafbb3-4c3b-45c6-917d-64e94f36336e', 'volume_name': 'volume-57cafbb3-4c3b-45c6-917d-64e94f36336e', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e93bcd3-e621-477c-bf32-38601678f8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e93bcd3-e621-477c-bf32-38601678f8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b0586f4-2bd1-4b63-a41e-7490d8e0c936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:19 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] Volume 57cafbb3-4c3b-45c6-917d-64e94f36336e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57cafbb3-4c3b-45c6-917d-64e94f36336e', 'volume_size': 1}
Nov 05 09:37:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:37:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:37:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1537838672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57cafbb3-4c3b-45c6-917d-64e94f36336e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df24e15bf71049f3b3ffe36007444444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:37:19Z,use_quota=True,user_id='26647e20a69d478a80c45c37332b5b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:37:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] Creating volume 57cafbb3-4c3b-45c6-917d-64e94f36336e {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:37:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:37:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:37:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:37:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:37:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:37:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:37:19 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:37:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57cafbb3-4c3b-45c6-917d-64e94f36336e 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:19 devstack sudo[95330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57cafbb3-4c3b-45c6-917d-64e94f36336e 1073741824
Nov 05 09:37:19 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:19 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57cafbb3-4c3b-45c6-917d-64e94f36336e 1073741824" returned: 0 in 0.457s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57cafbb3-4c3b-45c6-917d-64e94f36336e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:20 devstack sudo[95336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57cafbb3-4c3b-45c6-917d-64e94f36336e
Nov 05 09:37:20 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:20 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57cafbb3-4c3b-45c6-917d-64e94f36336e" returned: 0 in 0.271s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:37:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:37:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b0586f4-2bd1-4b63-a41e-7490d8e0c936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57cafbb3-4c3b-45c6-917d-64e94f36336e', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a687914-940e-4d70-a3d1-ca6ba0304aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:20 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] Volume volume-57cafbb3-4c3b-45c6-917d-64e94f36336e (57cafbb3-4c3b-45c6-917d-64e94f36336e): created successfully
Nov 05 09:37:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a687914-940e-4d70-a3d1-ca6ba0304aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] Flow 'volume_create_manager' (b1b30cfc-b608-4697-98c9-4d5b2681c9a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:37:20 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c6db8a15-0c08-49fc-a28a-ae9a7ec718df tempest-VolumesTransfersV355Test-940195032 None] Created volume successfully.
Nov 05 09:37:21 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-09c3c1bf-43cb-4868-a40f-ab69ec9a94c6 tempest-VolumesTransfersV355Test-1141793933 None] Transfer volume completed successfully.
Nov 05 09:37:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5737f6db-18ae-4cba-af35-776c906d2fb2 tempest-VolumesTransfersV355Test-1642793482 None] Acquiring lock "cinder-57cafbb3-4c3b-45c6-917d-64e94f36336e-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:37:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5737f6db-18ae-4cba-af35-776c906d2fb2 tempest-VolumesTransfersV355Test-1642793482 None] Lock "cinder-57cafbb3-4c3b-45c6-917d-64e94f36336e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:37:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5737f6db-18ae-4cba-af35-776c906d2fb2 tempest-VolumesTransfersV355Test-1642793482 None] Acquiring lock "cinder-quobyte-57cafbb3-4c3b-45c6-917d-64e94f36336e" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:37:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5737f6db-18ae-4cba-af35-776c906d2fb2 tempest-VolumesTransfersV355Test-1642793482 None] Lock "cinder-quobyte-57cafbb3-4c3b-45c6-917d-64e94f36336e" acquired by "delete_volume" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:37:21 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb87b46-0d18-4a90-b791-5dcfb9f75dba]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:37:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5737f6db-18ae-4cba-af35-776c906d2fb2 tempest-VolumesTransfersV355Test-1642793482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57cafbb3-4c3b-45c6-917d-64e94f36336e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:21 devstack sudo[95361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57cafbb3-4c3b-45c6-917d-64e94f36336e
Nov 05 09:37:21 devstack sudo[95361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:22 devstack sudo[95361]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5737f6db-18ae-4cba-af35-776c906d2fb2 tempest-VolumesTransfersV355Test-1642793482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57cafbb3-4c3b-45c6-917d-64e94f36336e" returned: 0 in 0.461s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5737f6db-18ae-4cba-af35-776c906d2fb2 tempest-VolumesTransfersV355Test-1642793482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57cafbb3-4c3b-45c6-917d-64e94f36336e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:22 devstack sudo[95366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57cafbb3-4c3b-45c6-917d-64e94f36336e
Nov 05 09:37:22 devstack sudo[95366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:22 devstack sudo[95366]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5737f6db-18ae-4cba-af35-776c906d2fb2 tempest-VolumesTransfersV355Test-1642793482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57cafbb3-4c3b-45c6-917d-64e94f36336e" returned: 0 in 0.275s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5737f6db-18ae-4cba-af35-776c906d2fb2 tempest-VolumesTransfersV355Test-1642793482 None] Lock "cinder-quobyte-57cafbb3-4c3b-45c6-917d-64e94f36336e" released by "delete_volume" :: held 0.789s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:37:22 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-5737f6db-18ae-4cba-af35-776c906d2fb2 tempest-VolumesTransfersV355Test-1642793482 None] Created reservations ['be279fe5-69e1-4cc5-bc3a-c8c2b15738df', '1573b2d6-fa5c-45b7-b8a4-a51228ca4e1e', 'deea43fe-9086-42a4-918a-2f81edba73e9', 'c2a0c8fd-a429-45e8-b22e-7d08185f9611'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:37:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5737f6db-18ae-4cba-af35-776c906d2fb2 tempest-VolumesTransfersV355Test-1642793482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:37:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5737f6db-18ae-4cba-af35-776c906d2fb2 tempest-VolumesTransfersV355Test-1642793482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:37:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5737f6db-18ae-4cba-af35-776c906d2fb2 tempest-VolumesTransfersV355Test-1642793482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:37:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5737f6db-18ae-4cba-af35-776c906d2fb2 tempest-VolumesTransfersV355Test-1642793482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:37:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5737f6db-18ae-4cba-af35-776c906d2fb2 tempest-VolumesTransfersV355Test-1642793482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:37:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5737f6db-18ae-4cba-af35-776c906d2fb2 tempest-VolumesTransfersV355Test-1642793482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:22 devstack sudo[95370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:37:22 devstack sudo[95370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:23 devstack sudo[95370]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5737f6db-18ae-4cba-af35-776c906d2fb2 tempest-VolumesTransfersV355Test-1642793482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.446s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:23 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-5737f6db-18ae-4cba-af35-776c906d2fb2 tempest-VolumesTransfersV355Test-1642793482 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:37:23 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-5737f6db-18ae-4cba-af35-776c906d2fb2 tempest-VolumesTransfersV355Test-1642793482 None] Deleted volume successfully.
Nov 05 09:37:23 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5737f6db-18ae-4cba-af35-776c906d2fb2 tempest-VolumesTransfersV355Test-1642793482 None] Lock "cinder-57cafbb3-4c3b-45c6-917d-64e94f36336e-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:37:23 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:37:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] Flow 'volume_create_manager' (c54c3a15-44ea-492a-b9e5-20426bf652f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:37:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e21c8012-3f79-45de-a1cf-3800a713c3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e21c8012-3f79-45de-a1cf-3800a713c3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1493410634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a724ea-15a8-4dab-bac4-d2dce7504fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df24e15bf71049f3b3ffe36007444444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:37:24Z,use_quota=True,user_id='26647e20a69d478a80c45c37332b5b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f185d2-dcb5-4b1d-8716-263913d64a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f185d2-dcb5-4b1d-8716-263913d64a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f559d797-72c2-4cf4-a5fe-7c302e70d96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f559d797-72c2-4cf4-a5fe-7c302e70d96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7a724ea-15a8-4dab-bac4-d2dce7504fb6', 'volume_name': 'volume-f7a724ea-15a8-4dab-bac4-d2dce7504fb6', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e69a63b-5ffb-40ce-ac6d-38cc53391911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e69a63b-5ffb-40ce-ac6d-38cc53391911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (262cc64d-7dbc-4777-8b6b-0a9855bfd086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:24 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] Volume f7a724ea-15a8-4dab-bac4-d2dce7504fb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7a724ea-15a8-4dab-bac4-d2dce7504fb6', 'volume_size': 1}
Nov 05 09:37:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:37:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:37:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1493410634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a724ea-15a8-4dab-bac4-d2dce7504fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df24e15bf71049f3b3ffe36007444444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:37:24Z,use_quota=True,user_id='26647e20a69d478a80c45c37332b5b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:37:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] Creating volume f7a724ea-15a8-4dab-bac4-d2dce7504fb6 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:37:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:37:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:37:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:37:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:37:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:37:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:37:24 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:37:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f7a724ea-15a8-4dab-bac4-d2dce7504fb6 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:24 devstack sudo[95394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f7a724ea-15a8-4dab-bac4-d2dce7504fb6 1073741824
Nov 05 09:37:24 devstack sudo[95394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:24 devstack sudo[95394]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f7a724ea-15a8-4dab-bac4-d2dce7504fb6 1073741824" returned: 0 in 0.534s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f7a724ea-15a8-4dab-bac4-d2dce7504fb6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:24 devstack sudo[95400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f7a724ea-15a8-4dab-bac4-d2dce7504fb6
Nov 05 09:37:24 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:25 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f7a724ea-15a8-4dab-bac4-d2dce7504fb6" returned: 0 in 0.369s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:37:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:37:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (262cc64d-7dbc-4777-8b6b-0a9855bfd086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7a724ea-15a8-4dab-bac4-d2dce7504fb6', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26bc79d2-8966-45cc-ac40-28d042385292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:25 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] Volume volume-f7a724ea-15a8-4dab-bac4-d2dce7504fb6 (f7a724ea-15a8-4dab-bac4-d2dce7504fb6): created successfully
Nov 05 09:37:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26bc79d2-8966-45cc-ac40-28d042385292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] Flow 'volume_create_manager' (c54c3a15-44ea-492a-b9e5-20426bf652f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:37:25 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-9c0143fd-b9b7-407a-855c-e00bb1afab8c tempest-VolumesTransfersV355Test-940195032 None] Created volume successfully.
Nov 05 09:37:26 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2de82aa0-100f-4c97-b01a-d6911d5156a9 tempest-VolumesTransfersV355Test-1642793482 None] Acquiring lock "cinder-f7a724ea-15a8-4dab-bac4-d2dce7504fb6-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:37:26 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2de82aa0-100f-4c97-b01a-d6911d5156a9 tempest-VolumesTransfersV355Test-1642793482 None] Lock "cinder-f7a724ea-15a8-4dab-bac4-d2dce7504fb6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:37:26 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2de82aa0-100f-4c97-b01a-d6911d5156a9 tempest-VolumesTransfersV355Test-1642793482 None] Acquiring lock "cinder-quobyte-f7a724ea-15a8-4dab-bac4-d2dce7504fb6" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:37:26 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2de82aa0-100f-4c97-b01a-d6911d5156a9 tempest-VolumesTransfersV355Test-1642793482 None] Lock "cinder-quobyte-f7a724ea-15a8-4dab-bac4-d2dce7504fb6" acquired by "delete_volume" :: waited 0.034s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:37:26 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-c6f723f0-c815-4aef-86cf-022bd19f4de0 req-1f0f7a5f-37a3-4c33-8781-facfa4cd4f75 tempest-AttachVolumeNegativeTest-1674973412 None] Terminate volume connection completed successfully.
Nov 05 09:37:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-c6f723f0-c815-4aef-86cf-022bd19f4de0 req-1f0f7a5f-37a3-4c33-8781-facfa4cd4f75 tempest-AttachVolumeNegativeTest-1674973412 None] Deleting attachment 836b6283-f634-4045-b062-2a14846a8489. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 09:37:26 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9dd17a-4bc7-4d86-a43b-74d92b98f5f0]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:37:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2de82aa0-100f-4c97-b01a-d6911d5156a9 tempest-VolumesTransfersV355Test-1642793482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f7a724ea-15a8-4dab-bac4-d2dce7504fb6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:26 devstack sudo[95411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f7a724ea-15a8-4dab-bac4-d2dce7504fb6
Nov 05 09:37:26 devstack sudo[95411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:27 devstack sudo[95411]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2de82aa0-100f-4c97-b01a-d6911d5156a9 tempest-VolumesTransfersV355Test-1642793482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f7a724ea-15a8-4dab-bac4-d2dce7504fb6" returned: 0 in 0.418s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2de82aa0-100f-4c97-b01a-d6911d5156a9 tempest-VolumesTransfersV355Test-1642793482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f7a724ea-15a8-4dab-bac4-d2dce7504fb6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:27 devstack sudo[95417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f7a724ea-15a8-4dab-bac4-d2dce7504fb6
Nov 05 09:37:27 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:27 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2de82aa0-100f-4c97-b01a-d6911d5156a9 tempest-VolumesTransfersV355Test-1642793482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f7a724ea-15a8-4dab-bac4-d2dce7504fb6" returned: 0 in 0.282s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2de82aa0-100f-4c97-b01a-d6911d5156a9 tempest-VolumesTransfersV355Test-1642793482 None] Lock "cinder-quobyte-f7a724ea-15a8-4dab-bac4-d2dce7504fb6" released by "delete_volume" :: held 0.766s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:37:27 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-2de82aa0-100f-4c97-b01a-d6911d5156a9 tempest-VolumesTransfersV355Test-1642793482 None] Created reservations ['bce8ad76-6b34-4164-8723-c1bbe394a5b6', 'c4d66694-2604-4660-95d5-831d20d6ad59', '97b611ae-e3bf-4027-a211-19bc1656df2a', 'e4794821-3dd0-4ee6-9cbc-1fa84a29fdc3'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:37:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2de82aa0-100f-4c97-b01a-d6911d5156a9 tempest-VolumesTransfersV355Test-1642793482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:37:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2de82aa0-100f-4c97-b01a-d6911d5156a9 tempest-VolumesTransfersV355Test-1642793482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:37:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2de82aa0-100f-4c97-b01a-d6911d5156a9 tempest-VolumesTransfersV355Test-1642793482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:37:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2de82aa0-100f-4c97-b01a-d6911d5156a9 tempest-VolumesTransfersV355Test-1642793482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:37:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2de82aa0-100f-4c97-b01a-d6911d5156a9 tempest-VolumesTransfersV355Test-1642793482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:37:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2de82aa0-100f-4c97-b01a-d6911d5156a9 tempest-VolumesTransfersV355Test-1642793482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:27 devstack sudo[95422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:37:27 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:27 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2de82aa0-100f-4c97-b01a-d6911d5156a9 tempest-VolumesTransfersV355Test-1642793482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.400s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:27 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-2de82aa0-100f-4c97-b01a-d6911d5156a9 tempest-VolumesTransfersV355Test-1642793482 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:37:27 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-2de82aa0-100f-4c97-b01a-d6911d5156a9 tempest-VolumesTransfersV355Test-1642793482 None] Deleted volume successfully.
Nov 05 09:37:28 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2de82aa0-100f-4c97-b01a-d6911d5156a9 tempest-VolumesTransfersV355Test-1642793482 None] Lock "cinder-f7a724ea-15a8-4dab-bac4-d2dce7504fb6-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:37:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ee3177f9-1c10-417d-bede-100b129e303b tempest-VolumesNegativeTest-1309039431 None] Acquiring lock "cinder-d223e593-4286-4465-8168-8cadd590293f-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:37:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ee3177f9-1c10-417d-bede-100b129e303b tempest-VolumesNegativeTest-1309039431 None] Lock "cinder-d223e593-4286-4465-8168-8cadd590293f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:37:35 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=99,cinder:DELETE=8,cinder:SELECT=60,cinder:INSERT=22 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:37:35 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=75,cinder:INSERT=23,cinder:UPDATE=93,cinder:DELETE=9 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:37:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ee3177f9-1c10-417d-bede-100b129e303b tempest-VolumesNegativeTest-1309039431 None] Acquiring lock "cinder-quobyte-d223e593-4286-4465-8168-8cadd590293f" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:37:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ee3177f9-1c10-417d-bede-100b129e303b tempest-VolumesNegativeTest-1309039431 None] Lock "cinder-quobyte-d223e593-4286-4465-8168-8cadd590293f" acquired by "delete_volume" :: waited 0.028s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:37:35 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[df27f771-b3cc-4acf-a51c-749a55cbde68]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:37:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ee3177f9-1c10-417d-bede-100b129e303b tempest-VolumesNegativeTest-1309039431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d223e593-4286-4465-8168-8cadd590293f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:35 devstack sudo[95486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d223e593-4286-4465-8168-8cadd590293f
Nov 05 09:37:35 devstack sudo[95486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:36 devstack sudo[95486]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ee3177f9-1c10-417d-bede-100b129e303b tempest-VolumesNegativeTest-1309039431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d223e593-4286-4465-8168-8cadd590293f" returned: 0 in 0.410s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ee3177f9-1c10-417d-bede-100b129e303b tempest-VolumesNegativeTest-1309039431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d223e593-4286-4465-8168-8cadd590293f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:36 devstack sudo[95493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d223e593-4286-4465-8168-8cadd590293f
Nov 05 09:37:36 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:36 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ee3177f9-1c10-417d-bede-100b129e303b tempest-VolumesNegativeTest-1309039431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d223e593-4286-4465-8168-8cadd590293f" returned: 0 in 0.296s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ee3177f9-1c10-417d-bede-100b129e303b tempest-VolumesNegativeTest-1309039431 None] Lock "cinder-quobyte-d223e593-4286-4465-8168-8cadd590293f" released by "delete_volume" :: held 0.767s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:37:36 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-ee3177f9-1c10-417d-bede-100b129e303b tempest-VolumesNegativeTest-1309039431 None] Created reservations ['4d717b87-dd10-4320-b8a9-150fa33fea28', '3af8d3b5-6660-4ff6-b7e5-84b5aa7dc9ac', 'cdf766ad-2332-4a69-82ea-3e0c4efcb22e', '54badf0a-82db-4f23-9007-31ec76249802'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:37:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ee3177f9-1c10-417d-bede-100b129e303b tempest-VolumesNegativeTest-1309039431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:37:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ee3177f9-1c10-417d-bede-100b129e303b tempest-VolumesNegativeTest-1309039431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:37:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ee3177f9-1c10-417d-bede-100b129e303b tempest-VolumesNegativeTest-1309039431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:37:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ee3177f9-1c10-417d-bede-100b129e303b tempest-VolumesNegativeTest-1309039431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:37:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ee3177f9-1c10-417d-bede-100b129e303b tempest-VolumesNegativeTest-1309039431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:37:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ee3177f9-1c10-417d-bede-100b129e303b tempest-VolumesNegativeTest-1309039431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:36 devstack sudo[95496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:37:36 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:37 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ee3177f9-1c10-417d-bede-100b129e303b tempest-VolumesNegativeTest-1309039431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.354s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:37 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-ee3177f9-1c10-417d-bede-100b129e303b tempest-VolumesNegativeTest-1309039431 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:37:37 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ee3177f9-1c10-417d-bede-100b129e303b tempest-VolumesNegativeTest-1309039431 None] Deleted volume successfully.
Nov 05 09:37:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ee3177f9-1c10-417d-bede-100b129e303b tempest-VolumesNegativeTest-1309039431 None] Lock "cinder-d223e593-4286-4465-8168-8cadd590293f-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:37:44 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:37:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Flow 'volume_create_manager' (a221b56b-78bd-4656-809b-88a515549239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:37:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70efb799-0b8c-4c75-8e51-a61df87ac4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70efb799-0b8c-4c75-8e51-a61df87ac4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2002696683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48284a50-31ed-4067-a79d-687464ebb0f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c80ea9b8b944f04921f552e09cb3305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:37:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:37:45Z,use_quota=True,user_id='f7b3634355774e3f96bb9ad29abdd6a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7271bd10-ef7a-4c72-93f4-a792d69f2694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7271bd10-ef7a-4c72-93f4-a792d69f2694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5caf6dd0-023c-4209-91f0-59722a5603a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5caf6dd0-023c-4209-91f0-59722a5603a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48284a50-31ed-4067-a79d-687464ebb0f9', 'volume_name': 'volume-48284a50-31ed-4067-a79d-687464ebb0f9', 'volume_size': 2}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74729c76-a720-4a58-86c3-b01d4900cc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74729c76-a720-4a58-86c3-b01d4900cc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab07b06-ab66-46b4-8180-e27feb453252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:44 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Volume 48284a50-31ed-4067-a79d-687464ebb0f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48284a50-31ed-4067-a79d-687464ebb0f9', 'volume_size': 2}
Nov 05 09:37:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:37:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:37:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2002696683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48284a50-31ed-4067-a79d-687464ebb0f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c80ea9b8b944f04921f552e09cb3305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:37:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:37:45Z,use_quota=True,user_id='f7b3634355774e3f96bb9ad29abdd6a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:37:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Creating volume 48284a50-31ed-4067-a79d-687464ebb0f9 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:37:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:37:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:37:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:37:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:37:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:37:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:37:44 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:37:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9 2147483648 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:44 devstack sudo[95508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9 2147483648
Nov 05 09:37:44 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:45 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9 2147483648" returned: 0 in 0.557s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:45 devstack sudo[95514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9
Nov 05 09:37:45 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:45 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9" returned: 0 in 0.267s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:37:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:37:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab07b06-ab66-46b4-8180-e27feb453252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48284a50-31ed-4067-a79d-687464ebb0f9', 'volume_size': 2}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f150b24-fb83-4aa1-b52b-eaf881a1bc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:45 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Volume volume-48284a50-31ed-4067-a79d-687464ebb0f9 (48284a50-31ed-4067-a79d-687464ebb0f9): created successfully
Nov 05 09:37:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f150b24-fb83-4aa1-b52b-eaf881a1bc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Flow 'volume_create_manager' (a221b56b-78bd-4656-809b-88a515549239) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:37:45 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b4137eec-3770-4670-9168-d476dfe823f6 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Created volume successfully.
Nov 05 09:37:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f53d3e67-ed58-4575-85c5-574e23830754 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:37:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f53d3e67-ed58-4575-85c5-574e23830754 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:37:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-f53d3e67-ed58-4575-85c5-574e23830754 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Creating offline snapshot b8dfc7bd-db5b-4cec-b3f7-44d60282ca61 of volume 48284a50-31ed-4067-a79d-687464ebb0f9 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 09:37:47 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba432ac9-603d-47b2-b847-caa6f1669017]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:37:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f53d3e67-ed58-4575-85c5-574e23830754 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:47 devstack sudo[95517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9
Nov 05 09:37:47 devstack sudo[95517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:47 devstack sudo[95517]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f53d3e67-ed58-4575-85c5-574e23830754 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9" returned: 0 in 0.435s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f53d3e67-ed58-4575-85c5-574e23830754 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9.b8dfc7bd-db5b-4cec-b3f7-44d60282ca61 2G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:47 devstack sudo[95522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9.b8dfc7bd-db5b-4cec-b3f7-44d60282ca61 2G
Nov 05 09:37:47 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:48 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f53d3e67-ed58-4575-85c5-574e23830754 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9.b8dfc7bd-db5b-4cec-b3f7-44d60282ca61 2G" returned: 0 in 0.587s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f53d3e67-ed58-4575-85c5-574e23830754 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48284a50-31ed-4067-a79d-687464ebb0f9 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9.b8dfc7bd-db5b-4cec-b3f7-44d60282ca61 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:48 devstack sudo[95530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48284a50-31ed-4067-a79d-687464ebb0f9 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9.b8dfc7bd-db5b-4cec-b3f7-44d60282ca61
Nov 05 09:37:48 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:48 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:37:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] Flow 'volume_create_manager' (fbb06806-c490-47e0-9f0b-48182a779d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:37:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb05e19-c8a6-4dac-99a6-653f36c800b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb05e19-c8a6-4dac-99a6-653f36c800b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-825896516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a72e7c-b8d7-4753-b6a9-931c9346f8ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4694f9af93994c27a70a89dcd7ad5d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:37:48Z,use_quota=True,user_id='9503ae989d3840579985cc39907e83a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49cf2bff-5972-4e33-bc4c-b6ee41818545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49cf2bff-5972-4e33-bc4c-b6ee41818545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6538244-6e60-4f81-aa5c-1558d2c8bd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6538244-6e60-4f81-aa5c-1558d2c8bd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7a72e7c-b8d7-4753-b6a9-931c9346f8ad', 'volume_name': 'volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c059ffa2-2ab8-42df-aa8a-2d275f3d97ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c059ffa2-2ab8-42df-aa8a-2d275f3d97ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f4a75f4-e4b5-4e3c-bff2-d0250f5f0637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:48 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] Volume b7a72e7c-b8d7-4753-b6a9-931c9346f8ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad', 'volume_size': 1}
Nov 05 09:37:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:37:48 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f53d3e67-ed58-4575-85c5-574e23830754 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48284a50-31ed-4067-a79d-687464ebb0f9 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9.b8dfc7bd-db5b-4cec-b3f7-44d60282ca61" returned: 0 in 0.370s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:48 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-f53d3e67-ed58-4575-85c5-574e23830754 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9.b8dfc7bd-db5b-4cec-b3f7-44d60282ca61 is being set with open permissions: ugo+rw
Nov 05 09:37:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f53d3e67-ed58-4575-85c5-574e23830754 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9.b8dfc7bd-db5b-4cec-b3f7-44d60282ca61 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:48 devstack sudo[95535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9.b8dfc7bd-db5b-4cec-b3f7-44d60282ca61
Nov 05 09:37:48 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:48 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f53d3e67-ed58-4575-85c5-574e23830754 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9.b8dfc7bd-db5b-4cec-b3f7-44d60282ca61" returned: 0 in 0.264s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f53d3e67-ed58-4575-85c5-574e23830754 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:48 devstack sudo[95539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9.info
Nov 05 09:37:48 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:49 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f53d3e67-ed58-4575-85c5-574e23830754 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9.info" returned: 0 in 0.293s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:49 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-f53d3e67-ed58-4575-85c5-574e23830754 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9.info is being set with open permissions: ugo+rw
Nov 05 09:37:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f53d3e67-ed58-4575-85c5-574e23830754 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:49 devstack sudo[95543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9.info
Nov 05 09:37:49 devstack sudo[95543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:49 devstack sudo[95543]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f53d3e67-ed58-4575-85c5-574e23830754 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9.info" returned: 0 in 0.275s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f53d3e67-ed58-4575-85c5-574e23830754 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.348s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:37:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.143s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:37:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-825896516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a72e7c-b8d7-4753-b6a9-931c9346f8ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4694f9af93994c27a70a89dcd7ad5d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:37:48Z,use_quota=True,user_id='9503ae989d3840579985cc39907e83a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:37:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] Creating volume b7a72e7c-b8d7-4753-b6a9-931c9346f8ad {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:37:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:37:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:37:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:37:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:37:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:37:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:37:49 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:37:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:49 devstack sudo[95547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad 1073741824
Nov 05 09:37:49 devstack sudo[95547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:49 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f53d3e67-ed58-4575-85c5-574e23830754 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Create snapshot completed successfully
Nov 05 09:37:49 devstack sudo[95547]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad 1073741824" returned: 0 in 0.509s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:49 devstack sudo[95566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad
Nov 05 09:37:49 devstack sudo[95566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c68b0a4a-7cf5-4621-a494-7a2a50806cb4 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Acquiring lock "cinder-b8dfc7bd-db5b-4cec-b3f7-44d60282ca61-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:37:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c68b0a4a-7cf5-4621-a494-7a2a50806cb4 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Lock "cinder-b8dfc7bd-db5b-4cec-b3f7-44d60282ca61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:37:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c68b0a4a-7cf5-4621-a494-7a2a50806cb4 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Acquiring lock "cinder-quobyte-48284a50-31ed-4067-a79d-687464ebb0f9" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:37:50 devstack sudo[95566]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad" returned: 0 in 0.329s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:37:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:37:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f4a75f4-e4b5-4e3c-bff2-d0250f5f0637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc90397b-9f67-4df8-86b5-c6929849500c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c68b0a4a-7cf5-4621-a494-7a2a50806cb4 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Lock "cinder-quobyte-48284a50-31ed-4067-a79d-687464ebb0f9" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:37:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c68b0a4a-7cf5-4621-a494-7a2a50806cb4 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Acquiring lock "cinder-quobyte-b8dfc7bd-db5b-4cec-b3f7-44d60282ca61" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:37:50 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] Volume volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad (b7a72e7c-b8d7-4753-b6a9-931c9346f8ad): created successfully
Nov 05 09:37:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc90397b-9f67-4df8-86b5-c6929849500c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] Flow 'volume_create_manager' (fbb06806-c490-47e0-9f0b-48182a779d90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:37:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c68b0a4a-7cf5-4621-a494-7a2a50806cb4 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Lock "cinder-quobyte-b8dfc7bd-db5b-4cec-b3f7-44d60282ca61" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:37:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c68b0a4a-7cf5-4621-a494-7a2a50806cb4 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Deleting offline snapshot b8dfc7bd-db5b-4cec-b3f7-44d60282ca61 of volume 48284a50-31ed-4067-a79d-687464ebb0f9 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 09:37:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c68b0a4a-7cf5-4621-a494-7a2a50806cb4 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] snapshot_file for this snap is: volume-48284a50-31ed-4067-a79d-687464ebb0f9.b8dfc7bd-db5b-4cec-b3f7-44d60282ca61 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 09:37:50 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c926f808-4559-499d-b0b3-23d35d9b3701 tempest-VolumesSnapshotTestJSON-1694161823 None] Created volume successfully.
Nov 05 09:37:50 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7b5cd5-9ab3-4a86-a454-45443c997702]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:37:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c68b0a4a-7cf5-4621-a494-7a2a50806cb4 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9.b8dfc7bd-db5b-4cec-b3f7-44d60282ca61 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:50 devstack sudo[95571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9.b8dfc7bd-db5b-4cec-b3f7-44d60282ca61
Nov 05 09:37:50 devstack sudo[95571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:50 devstack sudo[95571]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c68b0a4a-7cf5-4621-a494-7a2a50806cb4 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9.b8dfc7bd-db5b-4cec-b3f7-44d60282ca61" returned: 0 in 0.398s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c68b0a4a-7cf5-4621-a494-7a2a50806cb4 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48284a50-31ed-4067-a79d-687464ebb0f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:37:50 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae21c298-af19-4c28-af9f-6012da047669]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:37:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c68b0a4a-7cf5-4621-a494-7a2a50806cb4 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:50 devstack sudo[95576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9
Nov 05 09:37:50 devstack sudo[95576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:51 devstack sudo[95576]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c68b0a4a-7cf5-4621-a494-7a2a50806cb4 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9" returned: 0 in 0.406s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c68b0a4a-7cf5-4621-a494-7a2a50806cb4 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9.b8dfc7bd-db5b-4cec-b3f7-44d60282ca61 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:51 devstack sudo[95581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9.b8dfc7bd-db5b-4cec-b3f7-44d60282ca61
Nov 05 09:37:51 devstack sudo[95581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-95fc0a61-d8b3-4e2f-9c4e-8bf41710bdd9 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:37:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-95fc0a61-d8b3-4e2f-9c4e-8bf41710bdd9 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:37:51 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-95fc0a61-d8b3-4e2f-9c4e-8bf41710bdd9 tempest-VolumesSnapshotTestJSON-1694161823 None] Creating offline snapshot db995e39-83b5-4dcb-87ed-6529276e8412 of volume b7a72e7c-b8d7-4753-b6a9-931c9346f8ad {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 09:37:51 devstack sudo[95581]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c68b0a4a-7cf5-4621-a494-7a2a50806cb4 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9.b8dfc7bd-db5b-4cec-b3f7-44d60282ca61" returned: 0 in 0.507s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c68b0a4a-7cf5-4621-a494-7a2a50806cb4 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9.b8dfc7bd-db5b-4cec-b3f7-44d60282ca61 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:51 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[7315510b-48ff-45fc-a8d9-eba9374d9faa]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:37:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-95fc0a61-d8b3-4e2f-9c4e-8bf41710bdd9 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:51 devstack sudo[95587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9.b8dfc7bd-db5b-4cec-b3f7-44d60282ca61
Nov 05 09:37:51 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:51 devstack sudo[95588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad
Nov 05 09:37:51 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:52 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c68b0a4a-7cf5-4621-a494-7a2a50806cb4 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9.b8dfc7bd-db5b-4cec-b3f7-44d60282ca61" returned: 0 in 0.323s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c68b0a4a-7cf5-4621-a494-7a2a50806cb4 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Lock "cinder-quobyte-b8dfc7bd-db5b-4cec-b3f7-44d60282ca61" released by "_delete_snapshot" :: held 1.774s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:37:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c68b0a4a-7cf5-4621-a494-7a2a50806cb4 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Lock "cinder-quobyte-48284a50-31ed-4067-a79d-687464ebb0f9" released by "delete_snapshot" :: held 1.815s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:37:52 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-c68b0a4a-7cf5-4621-a494-7a2a50806cb4 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Created reservations ['9027ef15-080e-4bad-beaf-34afcdc9f7d1', 'f72fadbe-e2a8-4f5a-8422-6591d0b25423', '5a46ab7e-30f7-4d09-a510-c1797ba016b1', '3312a33f-95c7-47c0-b25f-81155dcd0440'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:37:52 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-95fc0a61-d8b3-4e2f-9c4e-8bf41710bdd9 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad" returned: 0 in 0.599s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-95fc0a61-d8b3-4e2f-9c4e-8bf41710bdd9 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad.db995e39-83b5-4dcb-87ed-6529276e8412 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:52 devstack sudo[95610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad.db995e39-83b5-4dcb-87ed-6529276e8412 1G
Nov 05 09:37:52 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:52 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c68b0a4a-7cf5-4621-a494-7a2a50806cb4 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Delete snapshot completed successfully.
Nov 05 09:37:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c68b0a4a-7cf5-4621-a494-7a2a50806cb4 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Lock "cinder-b8dfc7bd-db5b-4cec-b3f7-44d60282ca61-delete_snapshot" released by "delete_snapshot" :: held 2.244s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:37:53 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-95fc0a61-d8b3-4e2f-9c4e-8bf41710bdd9 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad.db995e39-83b5-4dcb-87ed-6529276e8412 1G" returned: 0 in 0.677s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-95fc0a61-d8b3-4e2f-9c4e-8bf41710bdd9 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad.db995e39-83b5-4dcb-87ed-6529276e8412 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:53 devstack sudo[95661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad.db995e39-83b5-4dcb-87ed-6529276e8412
Nov 05 09:37:53 devstack sudo[95661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:53 devstack sudo[95661]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-95fc0a61-d8b3-4e2f-9c4e-8bf41710bdd9 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad.db995e39-83b5-4dcb-87ed-6529276e8412" returned: 0 in 0.418s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:53 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-95fc0a61-d8b3-4e2f-9c4e-8bf41710bdd9 tempest-VolumesSnapshotTestJSON-1694161823 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad.db995e39-83b5-4dcb-87ed-6529276e8412 is being set with open permissions: ugo+rw
Nov 05 09:37:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-95fc0a61-d8b3-4e2f-9c4e-8bf41710bdd9 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad.db995e39-83b5-4dcb-87ed-6529276e8412 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:53 devstack sudo[95671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad.db995e39-83b5-4dcb-87ed-6529276e8412
Nov 05 09:37:53 devstack sudo[95671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2211300d-ca89-4a97-b09e-609ee863c1f0 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Acquiring lock "cinder-48284a50-31ed-4067-a79d-687464ebb0f9-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:37:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2211300d-ca89-4a97-b09e-609ee863c1f0 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Lock "cinder-48284a50-31ed-4067-a79d-687464ebb0f9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:37:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2211300d-ca89-4a97-b09e-609ee863c1f0 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Acquiring lock "cinder-quobyte-48284a50-31ed-4067-a79d-687464ebb0f9" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:37:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2211300d-ca89-4a97-b09e-609ee863c1f0 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Lock "cinder-quobyte-48284a50-31ed-4067-a79d-687464ebb0f9" acquired by "delete_volume" :: waited 0.028s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:37:53 devstack sudo[95671]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-95fc0a61-d8b3-4e2f-9c4e-8bf41710bdd9 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad.db995e39-83b5-4dcb-87ed-6529276e8412" returned: 0 in 0.282s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:53 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ad0fc9-fb12-46e2-b399-8a04e82fee10]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:37:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2211300d-ca89-4a97-b09e-609ee863c1f0 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-95fc0a61-d8b3-4e2f-9c4e-8bf41710bdd9 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:53 devstack sudo[95675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad.info
Nov 05 09:37:53 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:53 devstack sudo[95674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9
Nov 05 09:37:53 devstack sudo[95674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:54 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-95fc0a61-d8b3-4e2f-9c4e-8bf41710bdd9 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad.info" returned: 0 in 0.282s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:54 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-95fc0a61-d8b3-4e2f-9c4e-8bf41710bdd9 tempest-VolumesSnapshotTestJSON-1694161823 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad.info is being set with open permissions: ugo+rw
Nov 05 09:37:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-95fc0a61-d8b3-4e2f-9c4e-8bf41710bdd9 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:54 devstack sudo[95682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad.info
Nov 05 09:37:54 devstack sudo[95682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:54 devstack sudo[95674]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2211300d-ca89-4a97-b09e-609ee863c1f0 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9" returned: 0 in 0.395s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2211300d-ca89-4a97-b09e-609ee863c1f0 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:54 devstack sudo[95684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9
Nov 05 09:37:54 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:54 devstack sudo[95682]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-95fc0a61-d8b3-4e2f-9c4e-8bf41710bdd9 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad.info" returned: 0 in 0.260s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-95fc0a61-d8b3-4e2f-9c4e-8bf41710bdd9 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.666s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:37:54 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2211300d-ca89-4a97-b09e-609ee863c1f0 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48284a50-31ed-4067-a79d-687464ebb0f9" returned: 0 in 0.272s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2211300d-ca89-4a97-b09e-609ee863c1f0 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Lock "cinder-quobyte-48284a50-31ed-4067-a79d-687464ebb0f9" released by "delete_volume" :: held 0.762s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:37:54 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-95fc0a61-d8b3-4e2f-9c4e-8bf41710bdd9 tempest-VolumesSnapshotTestJSON-1694161823 None] Create snapshot completed successfully
Nov 05 09:37:54 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-2211300d-ca89-4a97-b09e-609ee863c1f0 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Created reservations ['4e7baa22-2c00-4161-b2b0-1c20290f7211', 'ae10dd3d-b82a-45f4-876d-28fe0fab5915', '9531509a-9be1-4fcc-b455-a4c159f1d132', '7f38052f-e17b-4151-b57c-48fa30e9fc07'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:37:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2211300d-ca89-4a97-b09e-609ee863c1f0 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:37:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2211300d-ca89-4a97-b09e-609ee863c1f0 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:37:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2211300d-ca89-4a97-b09e-609ee863c1f0 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:37:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2211300d-ca89-4a97-b09e-609ee863c1f0 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:37:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2211300d-ca89-4a97-b09e-609ee863c1f0 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:37:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2211300d-ca89-4a97-b09e-609ee863c1f0 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:54 devstack sudo[95688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:37:54 devstack sudo[95688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:54 devstack sudo[95688]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2211300d-ca89-4a97-b09e-609ee863c1f0 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.276s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:54 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-2211300d-ca89-4a97-b09e-609ee863c1f0 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:37:54 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-2211300d-ca89-4a97-b09e-609ee863c1f0 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Deleted volume successfully.
Nov 05 09:37:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2211300d-ca89-4a97-b09e-609ee863c1f0 tempest-VolumesSnapshotNegativeTestJSON-1854828352 None] Lock "cinder-48284a50-31ed-4067-a79d-687464ebb0f9-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:37:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-eab27a04-0c0a-432c-ba89-0ded3a9c0074 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "cinder-db995e39-83b5-4dcb-87ed-6529276e8412-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:37:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-eab27a04-0c0a-432c-ba89-0ded3a9c0074 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-db995e39-83b5-4dcb-87ed-6529276e8412-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:37:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-eab27a04-0c0a-432c-ba89-0ded3a9c0074 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "cinder-quobyte-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:37:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-eab27a04-0c0a-432c-ba89-0ded3a9c0074 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-quobyte-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:37:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-eab27a04-0c0a-432c-ba89-0ded3a9c0074 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "cinder-quobyte-db995e39-83b5-4dcb-87ed-6529276e8412" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:37:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-eab27a04-0c0a-432c-ba89-0ded3a9c0074 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-quobyte-db995e39-83b5-4dcb-87ed-6529276e8412" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:37:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-eab27a04-0c0a-432c-ba89-0ded3a9c0074 tempest-VolumesSnapshotTestJSON-1694161823 None] Deleting offline snapshot db995e39-83b5-4dcb-87ed-6529276e8412 of volume b7a72e7c-b8d7-4753-b6a9-931c9346f8ad {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 09:37:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-eab27a04-0c0a-432c-ba89-0ded3a9c0074 tempest-VolumesSnapshotTestJSON-1694161823 None] snapshot_file for this snap is: volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad.db995e39-83b5-4dcb-87ed-6529276e8412 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 09:37:55 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5776a31-d6e7-4019-92da-6f541b375a9f]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:37:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eab27a04-0c0a-432c-ba89-0ded3a9c0074 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad.db995e39-83b5-4dcb-87ed-6529276e8412 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:55 devstack sudo[95691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad.db995e39-83b5-4dcb-87ed-6529276e8412
Nov 05 09:37:55 devstack sudo[95691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:55 devstack sudo[95691]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eab27a04-0c0a-432c-ba89-0ded3a9c0074 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad.db995e39-83b5-4dcb-87ed-6529276e8412" returned: 0 in 0.362s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-eab27a04-0c0a-432c-ba89-0ded3a9c0074 tempest-VolumesSnapshotTestJSON-1694161823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:37:55 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[9193dfef-4130-4299-bb85-f62223c8040d]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:37:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eab27a04-0c0a-432c-ba89-0ded3a9c0074 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:55 devstack sudo[95696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad
Nov 05 09:37:55 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:56 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eab27a04-0c0a-432c-ba89-0ded3a9c0074 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad" returned: 0 in 0.441s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eab27a04-0c0a-432c-ba89-0ded3a9c0074 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad.db995e39-83b5-4dcb-87ed-6529276e8412 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:56 devstack sudo[95701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad.db995e39-83b5-4dcb-87ed-6529276e8412
Nov 05 09:37:56 devstack sudo[95701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:56 devstack sudo[95701]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eab27a04-0c0a-432c-ba89-0ded3a9c0074 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad.db995e39-83b5-4dcb-87ed-6529276e8412" returned: 0 in 0.390s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eab27a04-0c0a-432c-ba89-0ded3a9c0074 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad.db995e39-83b5-4dcb-87ed-6529276e8412 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:56 devstack sudo[95707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad.db995e39-83b5-4dcb-87ed-6529276e8412
Nov 05 09:37:56 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:56 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eab27a04-0c0a-432c-ba89-0ded3a9c0074 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad.db995e39-83b5-4dcb-87ed-6529276e8412" returned: 0 in 0.277s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-eab27a04-0c0a-432c-ba89-0ded3a9c0074 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-quobyte-db995e39-83b5-4dcb-87ed-6529276e8412" released by "_delete_snapshot" :: held 1.597s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:37:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-eab27a04-0c0a-432c-ba89-0ded3a9c0074 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-quobyte-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad" released by "delete_snapshot" :: held 1.621s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:37:56 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-eab27a04-0c0a-432c-ba89-0ded3a9c0074 tempest-VolumesSnapshotTestJSON-1694161823 None] Created reservations ['060fc6a9-f8fc-4f98-abb9-b213ba20b8fd', 'd4e41b96-557c-4d57-8a41-d53afc6860a6', '4a3a3760-a649-4fa1-bacc-d15a981b72e6', '67b732a4-ba1d-4f12-bfb8-29560d06b79e'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:37:56 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-eab27a04-0c0a-432c-ba89-0ded3a9c0074 tempest-VolumesSnapshotTestJSON-1694161823 None] Delete snapshot completed successfully.
Nov 05 09:37:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-eab27a04-0c0a-432c-ba89-0ded3a9c0074 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-db995e39-83b5-4dcb-87ed-6529276e8412-delete_snapshot" released by "delete_snapshot" :: held 1.814s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:37:57 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:37:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] Flow 'volume_create_manager' (3f618f9f-4b2a-4bf6-9dfe-42b1d5cccc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:37:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a61e1f-890a-45ca-8f31-441e6031acc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a61e1f-890a-45ca-8f31-441e6031acc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1531957628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57e5468c-a823-4a18-9671-58f443dd2534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4694f9af93994c27a70a89dcd7ad5d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:37:58Z,use_quota=True,user_id='9503ae989d3840579985cc39907e83a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f27697ba-b866-4e69-bd9e-aa11c1296389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f27697ba-b866-4e69-bd9e-aa11c1296389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4444489-98ec-4c85-8225-3aef54efbe1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4444489-98ec-4c85-8225-3aef54efbe1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57e5468c-a823-4a18-9671-58f443dd2534', 'volume_name': 'volume-57e5468c-a823-4a18-9671-58f443dd2534', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cbbd8f8-8287-48cf-937a-802b98c2af93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cbbd8f8-8287-48cf-937a-802b98c2af93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (265de492-fc8c-4f57-93f6-1dab6986f00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:57 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] Volume 57e5468c-a823-4a18-9671-58f443dd2534: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57e5468c-a823-4a18-9671-58f443dd2534', 'volume_size': 1}
Nov 05 09:37:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:37:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:37:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1531957628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57e5468c-a823-4a18-9671-58f443dd2534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4694f9af93994c27a70a89dcd7ad5d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:37:58Z,use_quota=True,user_id='9503ae989d3840579985cc39907e83a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:37:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] Creating volume 57e5468c-a823-4a18-9671-58f443dd2534 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:37:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:37:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:37:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:37:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:37:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:37:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:37:57 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:37:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:57 devstack sudo[95710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534 1073741824
Nov 05 09:37:57 devstack sudo[95710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:58 devstack sudo[95710]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534 1073741824" returned: 0 in 0.466s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:37:58 devstack sudo[95716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534
Nov 05 09:37:58 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:37:58 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root
Nov 05 09:37:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534" returned: 0 in 0.275s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:37:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:37:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:37:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (265de492-fc8c-4f57-93f6-1dab6986f00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57e5468c-a823-4a18-9671-58f443dd2534', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6bd446e-4e10-4acb-ad8c-6f46893582b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:37:58 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] Volume volume-57e5468c-a823-4a18-9671-58f443dd2534 (57e5468c-a823-4a18-9671-58f443dd2534): created successfully
Nov 05 09:37:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6bd446e-4e10-4acb-ad8c-6f46893582b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:37:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] Flow 'volume_create_manager' (3f618f9f-4b2a-4bf6-9dfe-42b1d5cccc04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:37:58 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-0ab4678c-b0bf-463e-93f5-1f01d4f57000 tempest-VolumesSnapshotTestJSON-1694161823 None] Created volume successfully.
Nov 05 09:38:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2a7d0cd2-c164-4023-a7ba-1ac3adaf3d37 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:38:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2a7d0cd2-c164-4023-a7ba-1ac3adaf3d37 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:38:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-2a7d0cd2-c164-4023-a7ba-1ac3adaf3d37 tempest-VolumesSnapshotTestJSON-1694161823 None] Creating offline snapshot 2014d224-8bad-47cc-b8a9-18d5462c40fb of volume 57e5468c-a823-4a18-9671-58f443dd2534 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 09:38:00 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3b712b-b3ca-4e29-b439-1caf86c1ec26]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:38:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2a7d0cd2-c164-4023-a7ba-1ac3adaf3d37 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:38:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:38:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:38:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:38:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:38:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:38:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:00 devstack sudo[95720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534
Nov 05 09:38:00 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:00 devstack sudo[95721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:38:00 devstack sudo[95721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:00 devstack sudo[95721]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.319s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:38:00 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:38:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 28 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:38:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>, <Thread(tpool_thread_0, started daemon 132223357408960)>, <Thread(tpool_thread_1, started daemon 132223349016256)>, <Thread(tpool_thread_2, started daemon 132223340623552)>, <Thread(tpool_thread_3, started daemon 132223332230848)>, <Thread(tpool_thread_4, started daemon 132223323838144)>, <Thread(tpool_thread_5, started daemon 132223315445440)>, <Thread(tpool_thread_6, started daemon 132223307052736)>, <Thread(tpool_thread_7, started daemon 132223298660032)>, <Thread(tpool_thread_8, started daemon 132223290250944)>, <Thread(tpool_thread_9, started daemon 132223281841856)>, <Thread(tpool_thread_10, started daemon 132223273432768)>, <Thread(tpool_thread_11, started daemon 132223265023680)>, <Thread(tpool_thread_12, started daemon 132223256614592)>, <Thread(tpool_thread_13, started daemon 132223248205504)>, <Thread(tpool_thread_14, started daemon 132223239796416)>, <Thread(tpool_thread_15, started daemon 132223231387328)>, <Thread(tpool_thread_16, started daemon 132223222978240)>, <Thread(tpool_thread_17, started daemon 132223214569152)>, <Thread(tpool_thread_18, started daemon 132223206160064)>, <Thread(tpool_thread_19, started daemon 132223197750976)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:38:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2a7d0cd2-c164-4023-a7ba-1ac3adaf3d37 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534" returned: 0 in 0.423s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2a7d0cd2-c164-4023-a7ba-1ac3adaf3d37 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534.2014d224-8bad-47cc-b8a9-18d5462c40fb 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:00 devstack sudo[95728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534.2014d224-8bad-47cc-b8a9-18d5462c40fb 1G
Nov 05 09:38:00 devstack sudo[95728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:00 devstack sudo[95728]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2a7d0cd2-c164-4023-a7ba-1ac3adaf3d37 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534.2014d224-8bad-47cc-b8a9-18d5462c40fb 1G" returned: 0 in 0.438s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2a7d0cd2-c164-4023-a7ba-1ac3adaf3d37 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57e5468c-a823-4a18-9671-58f443dd2534 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534.2014d224-8bad-47cc-b8a9-18d5462c40fb {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:00 devstack sudo[95734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57e5468c-a823-4a18-9671-58f443dd2534 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534.2014d224-8bad-47cc-b8a9-18d5462c40fb
Nov 05 09:38:00 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:01 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2a7d0cd2-c164-4023-a7ba-1ac3adaf3d37 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57e5468c-a823-4a18-9671-58f443dd2534 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534.2014d224-8bad-47cc-b8a9-18d5462c40fb" returned: 0 in 0.295s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:01 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-2a7d0cd2-c164-4023-a7ba-1ac3adaf3d37 tempest-VolumesSnapshotTestJSON-1694161823 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534.2014d224-8bad-47cc-b8a9-18d5462c40fb is being set with open permissions: ugo+rw
Nov 05 09:38:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2a7d0cd2-c164-4023-a7ba-1ac3adaf3d37 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534.2014d224-8bad-47cc-b8a9-18d5462c40fb {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:01 devstack sudo[95739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534.2014d224-8bad-47cc-b8a9-18d5462c40fb
Nov 05 09:38:01 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:01 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2a7d0cd2-c164-4023-a7ba-1ac3adaf3d37 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534.2014d224-8bad-47cc-b8a9-18d5462c40fb" returned: 0 in 0.282s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2a7d0cd2-c164-4023-a7ba-1ac3adaf3d37 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:01 devstack sudo[95742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534.info
Nov 05 09:38:01 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:01 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2a7d0cd2-c164-4023-a7ba-1ac3adaf3d37 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534.info" returned: 0 in 0.298s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:01 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-2a7d0cd2-c164-4023-a7ba-1ac3adaf3d37 tempest-VolumesSnapshotTestJSON-1694161823 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534.info is being set with open permissions: ugo+rw
Nov 05 09:38:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2a7d0cd2-c164-4023-a7ba-1ac3adaf3d37 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:01 devstack sudo[95745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534.info
Nov 05 09:38:01 devstack sudo[95745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:02 devstack sudo[95745]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2a7d0cd2-c164-4023-a7ba-1ac3adaf3d37 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534.info" returned: 0 in 0.273s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2a7d0cd2-c164-4023-a7ba-1ac3adaf3d37 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.174s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:38:02 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-2a7d0cd2-c164-4023-a7ba-1ac3adaf3d37 tempest-VolumesSnapshotTestJSON-1694161823 None] Create snapshot completed successfully
Nov 05 09:38:03 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:38:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Flow 'volume_create_manager' (4dfc826a-d98f-4dc7-ba33-6c532c292d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:38:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af454ecf-16e4-43d1-9659-ff1be7d0b7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af454ecf-16e4-43d1-9659-ff1be7d0b7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1989669976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f781a53-7434-41fb-a819-92ce76e1613c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4694f9af93994c27a70a89dcd7ad5d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:38:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=2014d224-8bad-47cc-b8a9-18d5462c40fb,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:38:04Z,use_quota=True,user_id='9503ae989d3840579985cc39907e83a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ae44eb-516c-400e-b37f-61e7651901aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ae44eb-516c-400e-b37f-61e7651901aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8132219b-0061-4741-bdab-5daac47fe25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8132219b-0061-4741-bdab-5daac47fe25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2f781a53-7434-41fb-a819-92ce76e1613c', 'volume_name': 'volume-2f781a53-7434-41fb-a819-92ce76e1613c', 'volume_size': 2, 'snapshot_id': '2014d224-8bad-47cc-b8a9-18d5462c40fb'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad19c5df-7ea8-402a-8e8d-4c8cc91e25b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad19c5df-7ea8-402a-8e8d-4c8cc91e25b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5036f976-b8a2-4631-96d7-e33cb1a8ad77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:03 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Volume 2f781a53-7434-41fb-a819-92ce76e1613c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2f781a53-7434-41fb-a819-92ce76e1613c', 'volume_size': 2, 'snapshot_id': '2014d224-8bad-47cc-b8a9-18d5462c40fb'}
Nov 05 09:38:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:38:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:38:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "cinder-quobyte-2014d224-8bad-47cc-b8a9-18d5462c40fb-2f781a53-7434-41fb-a819-92ce76e1613c" by "_create_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:38:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-quobyte-2014d224-8bad-47cc-b8a9-18d5462c40fb-2f781a53-7434-41fb-a819-92ce76e1613c" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:38:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Creating volume 2f781a53-7434-41fb-a819-92ce76e1613c from snapshot 2014d224-8bad-47cc-b8a9-18d5462c40fb {{(pid=86649) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 09:38:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:38:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:38:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:38:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:38:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:38:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:38:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "cinder-quobyte-2f781a53-7434-41fb-a819-92ce76e1613c" by "_copy_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:38:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-quobyte-2f781a53-7434-41fb-a819-92ce76e1613c" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:38:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] snapshot: 2014d224-8bad-47cc-b8a9-18d5462c40fb, volume: 2f781a53-7434-41fb-a819-92ce76e1613c,  {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 09:38:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:38:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:38:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:38:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:38:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:38:04 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[c519afec-7768-4d54-a3f0-6c76dff3cdd9]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:38:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534.2014d224-8bad-47cc-b8a9-18d5462c40fb {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:04 devstack sudo[95766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534.2014d224-8bad-47cc-b8a9-18d5462c40fb
Nov 05 09:38:04 devstack sudo[95766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:04 devstack sudo[95766]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534.2014d224-8bad-47cc-b8a9-18d5462c40fb" returned: 0 in 0.406s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57e5468c-a823-4a18-9671-58f443dd2534(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:38:04 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[09834f49-51ef-465d-8b30-1ac23dea05f1]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:38:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:04 devstack sudo[95772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534
Nov 05 09:38:04 devstack sudo[95772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:04 devstack sudo[95772]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534" returned: 0 in 0.428s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534 {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 09:38:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Creating direct copy from snapshot {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 09:38:04 devstack cinder-volume[86649]: DEBUG cinder.utils [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Path /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2f781a53-7434-41fb-a819-92ce76e1613c not found in is_blk_device check {{(pid=86649) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 09:38:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2f781a53-7434-41fb-a819-92ce76e1613c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:05 devstack sudo[95777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2f781a53-7434-41fb-a819-92ce76e1613c
Nov 05 09:38:05 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:12 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2f781a53-7434-41fb-a819-92ce76e1613c" returned: 0 in 7.803s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:12 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Image conversion details: src /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534, size 1024.00 MB, duration 7.80 sec, destination /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2f781a53-7434-41fb-a819-92ce76e1613c {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 09:38:12 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Converted 1024.00 MB image at 131.21 MB/s
Nov 05 09:38:12 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2f781a53-7434-41fb-a819-92ce76e1613c is being set with open permissions: ugo+rw
Nov 05 09:38:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2f781a53-7434-41fb-a819-92ce76e1613c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:12 devstack sudo[95793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2f781a53-7434-41fb-a819-92ce76e1613c
Nov 05 09:38:12 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:13 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2f781a53-7434-41fb-a819-92ce76e1613c" returned: 0 in 0.310s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:13 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-quobyte-2f781a53-7434-41fb-a819-92ce76e1613c" released by "_copy_volume_from_snapshot" :: held 9.067s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:38:13 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-quobyte-2014d224-8bad-47cc-b8a9-18d5462c40fb-2f781a53-7434-41fb-a819-92ce76e1613c" released by "_create_volume_from_snapshot" :: held 9.155s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:38:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.178s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:38:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5036f976-b8a2-4631-96d7-e33cb1a8ad77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f781a53-7434-41fb-a819-92ce76e1613c', 'volume_size': 2, 'snapshot_id': '2014d224-8bad-47cc-b8a9-18d5462c40fb'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46193157-40f4-471a-8fa9-ab28931897b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:13 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Volume volume-2f781a53-7434-41fb-a819-92ce76e1613c (2f781a53-7434-41fb-a819-92ce76e1613c): created successfully
Nov 05 09:38:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46193157-40f4-471a-8fa9-ab28931897b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Flow 'volume_create_manager' (4dfc826a-d98f-4dc7-ba33-6c532c292d91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:38:13 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-7a208709-2fb8-444a-85d4-1dc13ea40cf8 tempest-VolumesSnapshotTestJSON-1694161823 None] Created volume successfully.
Nov 05 09:38:13 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-07a47afc-47db-49a5-bc1a-7b6c1c307e45 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "cinder-2f781a53-7434-41fb-a819-92ce76e1613c-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:38:13 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-07a47afc-47db-49a5-bc1a-7b6c1c307e45 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-2f781a53-7434-41fb-a819-92ce76e1613c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:38:13 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-07a47afc-47db-49a5-bc1a-7b6c1c307e45 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "cinder-quobyte-2f781a53-7434-41fb-a819-92ce76e1613c" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:38:14 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-07a47afc-47db-49a5-bc1a-7b6c1c307e45 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-quobyte-2f781a53-7434-41fb-a819-92ce76e1613c" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:38:14 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58c0c89-e995-4a03-8e44-b47b10386cc3]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:38:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-07a47afc-47db-49a5-bc1a-7b6c1c307e45 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2f781a53-7434-41fb-a819-92ce76e1613c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:14 devstack sudo[95796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2f781a53-7434-41fb-a819-92ce76e1613c
Nov 05 09:38:14 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:14 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-07a47afc-47db-49a5-bc1a-7b6c1c307e45 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2f781a53-7434-41fb-a819-92ce76e1613c" returned: 0 in 0.418s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-07a47afc-47db-49a5-bc1a-7b6c1c307e45 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2f781a53-7434-41fb-a819-92ce76e1613c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:14 devstack sudo[95801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2f781a53-7434-41fb-a819-92ce76e1613c
Nov 05 09:38:14 devstack sudo[95801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:14 devstack sudo[95801]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-07a47afc-47db-49a5-bc1a-7b6c1c307e45 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2f781a53-7434-41fb-a819-92ce76e1613c" returned: 0 in 0.256s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:14 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-07a47afc-47db-49a5-bc1a-7b6c1c307e45 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-quobyte-2f781a53-7434-41fb-a819-92ce76e1613c" released by "delete_volume" :: held 0.731s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:38:14 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-07a47afc-47db-49a5-bc1a-7b6c1c307e45 tempest-VolumesSnapshotTestJSON-1694161823 None] Created reservations ['9e253970-ff99-4de8-a0ef-ba318fddbea6', '92865581-1f9d-4479-86ea-63e9fc3fd160', 'aa440827-dc90-4ef3-960c-1b6a513ccbc4', 'fbcae65f-e8c4-48cc-a4d0-b49d08bc7921'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:38:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-07a47afc-47db-49a5-bc1a-7b6c1c307e45 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:38:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-07a47afc-47db-49a5-bc1a-7b6c1c307e45 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:38:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-07a47afc-47db-49a5-bc1a-7b6c1c307e45 tempest-VolumesSnapshotTestJSON-1694161823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:38:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-07a47afc-47db-49a5-bc1a-7b6c1c307e45 tempest-VolumesSnapshotTestJSON-1694161823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:38:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-07a47afc-47db-49a5-bc1a-7b6c1c307e45 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:38:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-07a47afc-47db-49a5-bc1a-7b6c1c307e45 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:14 devstack sudo[95804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:38:14 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9d21d791-903c-4f35-b670-0f548bc06d13 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "cinder-2014d224-8bad-47cc-b8a9-18d5462c40fb-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:38:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9d21d791-903c-4f35-b670-0f548bc06d13 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-2014d224-8bad-47cc-b8a9-18d5462c40fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:38:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9d21d791-903c-4f35-b670-0f548bc06d13 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "cinder-quobyte-57e5468c-a823-4a18-9671-58f443dd2534" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:38:15 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-07a47afc-47db-49a5-bc1a-7b6c1c307e45 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.302s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:15 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-07a47afc-47db-49a5-bc1a-7b6c1c307e45 tempest-VolumesSnapshotTestJSON-1694161823 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:38:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9d21d791-903c-4f35-b670-0f548bc06d13 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-quobyte-57e5468c-a823-4a18-9671-58f443dd2534" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:38:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9d21d791-903c-4f35-b670-0f548bc06d13 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "cinder-quobyte-2014d224-8bad-47cc-b8a9-18d5462c40fb" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:38:15 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-07a47afc-47db-49a5-bc1a-7b6c1c307e45 tempest-VolumesSnapshotTestJSON-1694161823 None] Deleted volume successfully.
Nov 05 09:38:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9d21d791-903c-4f35-b670-0f548bc06d13 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-quobyte-2014d224-8bad-47cc-b8a9-18d5462c40fb" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:38:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-9d21d791-903c-4f35-b670-0f548bc06d13 tempest-VolumesSnapshotTestJSON-1694161823 None] Deleting offline snapshot 2014d224-8bad-47cc-b8a9-18d5462c40fb of volume 57e5468c-a823-4a18-9671-58f443dd2534 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 09:38:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-9d21d791-903c-4f35-b670-0f548bc06d13 tempest-VolumesSnapshotTestJSON-1694161823 None] snapshot_file for this snap is: volume-57e5468c-a823-4a18-9671-58f443dd2534.2014d224-8bad-47cc-b8a9-18d5462c40fb {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 09:38:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-07a47afc-47db-49a5-bc1a-7b6c1c307e45 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-2f781a53-7434-41fb-a819-92ce76e1613c-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:38:15 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf60f2c9-0a7e-4cd5-92e0-d88e2810350d]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:38:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9d21d791-903c-4f35-b670-0f548bc06d13 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534.2014d224-8bad-47cc-b8a9-18d5462c40fb {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:15 devstack sudo[95807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534.2014d224-8bad-47cc-b8a9-18d5462c40fb
Nov 05 09:38:15 devstack sudo[95807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:15 devstack sudo[95807]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9d21d791-903c-4f35-b670-0f548bc06d13 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534.2014d224-8bad-47cc-b8a9-18d5462c40fb" returned: 0 in 0.418s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-9d21d791-903c-4f35-b670-0f548bc06d13 tempest-VolumesSnapshotTestJSON-1694161823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57e5468c-a823-4a18-9671-58f443dd2534(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:38:15 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce36eb7-c6a5-419a-928e-81acd24a0a76]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:38:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9d21d791-903c-4f35-b670-0f548bc06d13 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:15 devstack sudo[95812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534
Nov 05 09:38:15 devstack sudo[95812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:16 devstack sudo[95812]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9d21d791-903c-4f35-b670-0f548bc06d13 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534" returned: 0 in 0.573s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9d21d791-903c-4f35-b670-0f548bc06d13 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534.2014d224-8bad-47cc-b8a9-18d5462c40fb {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:16 devstack sudo[95817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534.2014d224-8bad-47cc-b8a9-18d5462c40fb
Nov 05 09:38:16 devstack sudo[95817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:16 devstack sudo[95817]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9d21d791-903c-4f35-b670-0f548bc06d13 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534.2014d224-8bad-47cc-b8a9-18d5462c40fb" returned: 0 in 0.388s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9d21d791-903c-4f35-b670-0f548bc06d13 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534.2014d224-8bad-47cc-b8a9-18d5462c40fb {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:16 devstack sudo[95823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534.2014d224-8bad-47cc-b8a9-18d5462c40fb
Nov 05 09:38:16 devstack sudo[95823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:16 devstack sudo[95823]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9d21d791-903c-4f35-b670-0f548bc06d13 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534.2014d224-8bad-47cc-b8a9-18d5462c40fb" returned: 0 in 0.273s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9d21d791-903c-4f35-b670-0f548bc06d13 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-quobyte-2014d224-8bad-47cc-b8a9-18d5462c40fb" released by "_delete_snapshot" :: held 1.778s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:38:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9d21d791-903c-4f35-b670-0f548bc06d13 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-quobyte-57e5468c-a823-4a18-9671-58f443dd2534" released by "delete_snapshot" :: held 1.812s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:38:17 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-9d21d791-903c-4f35-b670-0f548bc06d13 tempest-VolumesSnapshotTestJSON-1694161823 None] Created reservations ['14de076b-b60c-4c1b-ac39-d80055f7ab5b', 'c4e76acd-6a83-4240-854d-54f323ac4f53', '87409865-7d85-47b1-b2ee-9c40d614c679', '13343e06-1630-4ab9-9b1e-27ba2bd855bc'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:38:17 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-9d21d791-903c-4f35-b670-0f548bc06d13 tempest-VolumesSnapshotTestJSON-1694161823 None] Delete snapshot completed successfully.
Nov 05 09:38:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9d21d791-903c-4f35-b670-0f548bc06d13 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-2014d224-8bad-47cc-b8a9-18d5462c40fb-delete_snapshot" released by "delete_snapshot" :: held 1.971s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:38:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-89ad449b-f8f9-4e86-916f-c27951970f65 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "cinder-57e5468c-a823-4a18-9671-58f443dd2534-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:38:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-89ad449b-f8f9-4e86-916f-c27951970f65 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-57e5468c-a823-4a18-9671-58f443dd2534-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:38:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-89ad449b-f8f9-4e86-916f-c27951970f65 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "cinder-quobyte-57e5468c-a823-4a18-9671-58f443dd2534" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:38:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-89ad449b-f8f9-4e86-916f-c27951970f65 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-quobyte-57e5468c-a823-4a18-9671-58f443dd2534" acquired by "delete_volume" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:38:17 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75e2d5f-082a-4cc7-9150-f613e485c1e6]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:38:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-89ad449b-f8f9-4e86-916f-c27951970f65 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:17 devstack sudo[95826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534
Nov 05 09:38:17 devstack sudo[95826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:18 devstack sudo[95826]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-89ad449b-f8f9-4e86-916f-c27951970f65 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534" returned: 0 in 0.433s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-89ad449b-f8f9-4e86-916f-c27951970f65 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:18 devstack sudo[95831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534
Nov 05 09:38:18 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:18 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-89ad449b-f8f9-4e86-916f-c27951970f65 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57e5468c-a823-4a18-9671-58f443dd2534" returned: 0 in 0.266s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-89ad449b-f8f9-4e86-916f-c27951970f65 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-quobyte-57e5468c-a823-4a18-9671-58f443dd2534" released by "delete_volume" :: held 0.812s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:38:18 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-89ad449b-f8f9-4e86-916f-c27951970f65 tempest-VolumesSnapshotTestJSON-1694161823 None] Created reservations ['e71b3414-d920-4a81-8811-594aa9142054', 'a27c0ff8-bfeb-4ddf-9f44-c0470d633790', '33b52b75-0278-4c39-b1a3-2e9ab1a81d11', '572772e9-ea67-4237-b341-42ea6da54d5a'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:38:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-89ad449b-f8f9-4e86-916f-c27951970f65 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:38:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-89ad449b-f8f9-4e86-916f-c27951970f65 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:38:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-89ad449b-f8f9-4e86-916f-c27951970f65 tempest-VolumesSnapshotTestJSON-1694161823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:38:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-89ad449b-f8f9-4e86-916f-c27951970f65 tempest-VolumesSnapshotTestJSON-1694161823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:38:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-89ad449b-f8f9-4e86-916f-c27951970f65 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:38:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-89ad449b-f8f9-4e86-916f-c27951970f65 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:18 devstack sudo[95834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:38:18 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:18 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-89ad449b-f8f9-4e86-916f-c27951970f65 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.281s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:18 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-89ad449b-f8f9-4e86-916f-c27951970f65 tempest-VolumesSnapshotTestJSON-1694161823 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:38:18 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-89ad449b-f8f9-4e86-916f-c27951970f65 tempest-VolumesSnapshotTestJSON-1694161823 None] Deleted volume successfully.
Nov 05 09:38:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-89ad449b-f8f9-4e86-916f-c27951970f65 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-57e5468c-a823-4a18-9671-58f443dd2534-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:38:19 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:38:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] Flow 'volume_create_manager' (77e270a9-038f-4107-8ac5-3ff70d72698a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:38:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (851d7758-c5ed-40cb-94ca-1146d09c0492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (851d7758-c5ed-40cb-94ca-1146d09c0492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-867669966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30b3a9ae-f529-437e-a2d0-f1bdde678720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4694f9af93994c27a70a89dcd7ad5d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:38:19Z,use_quota=True,user_id='9503ae989d3840579985cc39907e83a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b3f799c-261a-46b5-8001-ba68bfe9a45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b3f799c-261a-46b5-8001-ba68bfe9a45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (259ade9b-d5d5-497c-9629-03c40722e082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (259ade9b-d5d5-497c-9629-03c40722e082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30b3a9ae-f529-437e-a2d0-f1bdde678720', 'volume_name': 'volume-30b3a9ae-f529-437e-a2d0-f1bdde678720', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d009ad42-1266-49f2-a720-ff52a7fe7cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d009ad42-1266-49f2-a720-ff52a7fe7cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec30253b-f3af-430b-a912-9f8f76383ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:19 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] Volume 30b3a9ae-f529-437e-a2d0-f1bdde678720: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30b3a9ae-f529-437e-a2d0-f1bdde678720', 'volume_size': 1}
Nov 05 09:38:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:38:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:38:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-867669966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30b3a9ae-f529-437e-a2d0-f1bdde678720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4694f9af93994c27a70a89dcd7ad5d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:38:19Z,use_quota=True,user_id='9503ae989d3840579985cc39907e83a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:38:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] Creating volume 30b3a9ae-f529-437e-a2d0-f1bdde678720 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:38:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:38:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:38:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:38:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:38:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:38:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:38:19 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:38:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:19 devstack sudo[95838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720 1073741824
Nov 05 09:38:19 devstack sudo[95838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:19 devstack sudo[95838]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720 1073741824" returned: 0 in 0.541s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:19 devstack sudo[95844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720
Nov 05 09:38:19 devstack sudo[95844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:20 devstack sudo[95844]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720" returned: 0 in 0.276s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:38:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:38:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec30253b-f3af-430b-a912-9f8f76383ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30b3a9ae-f529-437e-a2d0-f1bdde678720', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e3984a-c754-4002-8f53-3bf02fa7e251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:20 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] Volume volume-30b3a9ae-f529-437e-a2d0-f1bdde678720 (30b3a9ae-f529-437e-a2d0-f1bdde678720): created successfully
Nov 05 09:38:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e3984a-c754-4002-8f53-3bf02fa7e251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] Flow 'volume_create_manager' (77e270a9-038f-4107-8ac5-3ff70d72698a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:38:20 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b9848696-8fe8-4528-91e4-75ad8e88c944 tempest-VolumesSnapshotTestJSON-1694161823 None] Created volume successfully.
Nov 05 09:38:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cb493b51-7310-432e-bb1e-9d613628db4b tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:38:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cb493b51-7310-432e-bb1e-9d613628db4b tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:38:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-cb493b51-7310-432e-bb1e-9d613628db4b tempest-VolumesSnapshotTestJSON-1694161823 None] Creating offline snapshot 124b1896-4957-4bb7-b2b2-ac38a864f614 of volume 30b3a9ae-f529-437e-a2d0-f1bdde678720 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 09:38:21 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ff3fbd-b522-482c-a37c-83b0a2dbeba2]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:38:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cb493b51-7310-432e-bb1e-9d613628db4b tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:21 devstack sudo[95847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720
Nov 05 09:38:21 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:22 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cb493b51-7310-432e-bb1e-9d613628db4b tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720" returned: 0 in 0.437s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cb493b51-7310-432e-bb1e-9d613628db4b tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720.124b1896-4957-4bb7-b2b2-ac38a864f614 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:22 devstack sudo[95852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720.124b1896-4957-4bb7-b2b2-ac38a864f614 1G
Nov 05 09:38:22 devstack sudo[95852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:22 devstack sudo[95852]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cb493b51-7310-432e-bb1e-9d613628db4b tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720.124b1896-4957-4bb7-b2b2-ac38a864f614 1G" returned: 0 in 0.467s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cb493b51-7310-432e-bb1e-9d613628db4b tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30b3a9ae-f529-437e-a2d0-f1bdde678720 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720.124b1896-4957-4bb7-b2b2-ac38a864f614 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:22 devstack sudo[95858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30b3a9ae-f529-437e-a2d0-f1bdde678720 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720.124b1896-4957-4bb7-b2b2-ac38a864f614
Nov 05 09:38:22 devstack sudo[95858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:22 devstack sudo[95858]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cb493b51-7310-432e-bb1e-9d613628db4b tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30b3a9ae-f529-437e-a2d0-f1bdde678720 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720.124b1896-4957-4bb7-b2b2-ac38a864f614" returned: 0 in 0.329s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:22 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-cb493b51-7310-432e-bb1e-9d613628db4b tempest-VolumesSnapshotTestJSON-1694161823 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720.124b1896-4957-4bb7-b2b2-ac38a864f614 is being set with open permissions: ugo+rw
Nov 05 09:38:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cb493b51-7310-432e-bb1e-9d613628db4b tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720.124b1896-4957-4bb7-b2b2-ac38a864f614 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:22 devstack sudo[95863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720.124b1896-4957-4bb7-b2b2-ac38a864f614
Nov 05 09:38:22 devstack sudo[95863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:23 devstack sudo[95863]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cb493b51-7310-432e-bb1e-9d613628db4b tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720.124b1896-4957-4bb7-b2b2-ac38a864f614" returned: 0 in 0.252s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cb493b51-7310-432e-bb1e-9d613628db4b tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:23 devstack sudo[95866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720.info
Nov 05 09:38:23 devstack sudo[95866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:23 devstack sudo[95866]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cb493b51-7310-432e-bb1e-9d613628db4b tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720.info" returned: 0 in 0.281s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:23 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-cb493b51-7310-432e-bb1e-9d613628db4b tempest-VolumesSnapshotTestJSON-1694161823 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720.info is being set with open permissions: ugo+rw
Nov 05 09:38:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cb493b51-7310-432e-bb1e-9d613628db4b tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:23 devstack sudo[95869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720.info
Nov 05 09:38:23 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:23 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cb493b51-7310-432e-bb1e-9d613628db4b tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720.info" returned: 0 in 0.271s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cb493b51-7310-432e-bb1e-9d613628db4b tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.175s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:38:23 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-cb493b51-7310-432e-bb1e-9d613628db4b tempest-VolumesSnapshotTestJSON-1694161823 None] Create snapshot completed successfully
Nov 05 09:38:25 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:38:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Flow 'volume_create_manager' (8d7be2e4-b79e-4508-8071-8a888a1a0dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:38:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1309f29-dbde-4de3-babf-cbbc0cf33fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1309f29-dbde-4de3-babf-cbbc0cf33fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1790516074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=771e8a57-eb0e-493a-8981-0de828189940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4694f9af93994c27a70a89dcd7ad5d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=124b1896-4957-4bb7-b2b2-ac38a864f614,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:38:25Z,use_quota=True,user_id='9503ae989d3840579985cc39907e83a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94fde573-0dc9-4d8d-a79e-f54b9663491b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94fde573-0dc9-4d8d-a79e-f54b9663491b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82fd5fd-f271-442f-936a-56da1b9209d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82fd5fd-f271-442f-936a-56da1b9209d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '771e8a57-eb0e-493a-8981-0de828189940', 'volume_name': 'volume-771e8a57-eb0e-493a-8981-0de828189940', 'volume_size': 1, 'snapshot_id': '124b1896-4957-4bb7-b2b2-ac38a864f614'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d6b501f-df87-464a-95b1-05cd92c2fd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d6b501f-df87-464a-95b1-05cd92c2fd87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e5e4cd7-b695-4ea6-81ba-3a45040730e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:25 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Volume 771e8a57-eb0e-493a-8981-0de828189940: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-771e8a57-eb0e-493a-8981-0de828189940', 'volume_size': 1, 'snapshot_id': '124b1896-4957-4bb7-b2b2-ac38a864f614'}
Nov 05 09:38:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:38:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:38:25 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "cinder-quobyte-124b1896-4957-4bb7-b2b2-ac38a864f614-771e8a57-eb0e-493a-8981-0de828189940" by "_create_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:38:25 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-quobyte-124b1896-4957-4bb7-b2b2-ac38a864f614-771e8a57-eb0e-493a-8981-0de828189940" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:38:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Creating volume 771e8a57-eb0e-493a-8981-0de828189940 from snapshot 124b1896-4957-4bb7-b2b2-ac38a864f614 {{(pid=86649) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 09:38:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:38:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:38:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:38:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:38:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:38:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:38:25 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "cinder-quobyte-771e8a57-eb0e-493a-8981-0de828189940" by "_copy_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:38:25 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-quobyte-771e8a57-eb0e-493a-8981-0de828189940" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:38:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] snapshot: 124b1896-4957-4bb7-b2b2-ac38a864f614, volume: 771e8a57-eb0e-493a-8981-0de828189940,  {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 09:38:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:38:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:38:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:38:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:38:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:38:25 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e4b507-6f01-457c-b637-5e143f027d74]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:38:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720.124b1896-4957-4bb7-b2b2-ac38a864f614 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:25 devstack sudo[95873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720.124b1896-4957-4bb7-b2b2-ac38a864f614
Nov 05 09:38:25 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:26 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720.124b1896-4957-4bb7-b2b2-ac38a864f614" returned: 0 in 0.472s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30b3a9ae-f529-437e-a2d0-f1bdde678720(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:38:26 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[4419f114-1780-4a3a-9fa7-bb8deed51694]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:38:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:26 devstack sudo[95878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720
Nov 05 09:38:26 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:26 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720" returned: 0 in 0.385s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720 {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 09:38:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Creating direct copy from snapshot {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 09:38:26 devstack cinder-volume[86649]: DEBUG cinder.utils [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Path /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-771e8a57-eb0e-493a-8981-0de828189940 not found in is_blk_device check {{(pid=86649) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 09:38:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-771e8a57-eb0e-493a-8981-0de828189940 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:26 devstack sudo[95883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-771e8a57-eb0e-493a-8981-0de828189940
Nov 05 09:38:26 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:31 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:38:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] Flow 'volume_create_manager' (c2d54365-1c3b-4673-a231-bf74361e6c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:38:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fefd1a02-cf71-4176-b4a3-a014da1e1557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fefd1a02-cf71-4176-b4a3-a014da1e1557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-957350192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a58e882d-3907-4dfd-a5ff-e56505f592b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64afce00cae44f6da12fe57072e08616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:38:32Z,use_quota=True,user_id='be4644ac8afe457bb6c03a9ad4510780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee9448f4-7401-4d3b-8930-b07d3521ab82),volume_type_id=ee9448f4-7401-4d3b-8930-b07d3521ab82)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d61215-80bd-4bff-9b55-ebfdf5877386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d61215-80bd-4bff-9b55-ebfdf5877386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be75a9e1-a772-468b-b916-e8d408b058b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be75a9e1-a772-468b-b916-e8d408b058b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a58e882d-3907-4dfd-a5ff-e56505f592b1', 'volume_name': 'volume-a58e882d-3907-4dfd-a5ff-e56505f592b1', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (274331c5-28e1-4952-81d5-c9e2839c3dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (274331c5-28e1-4952-81d5-c9e2839c3dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1871d553-eb48-48ef-adce-0207f9adf3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:31 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] Volume a58e882d-3907-4dfd-a5ff-e56505f592b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a58e882d-3907-4dfd-a5ff-e56505f592b1', 'volume_size': 1}
Nov 05 09:38:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:38:32 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:38:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] Flow 'volume_create_manager' (48d30bd8-5268-427b-8c4c-b46a6ac6e2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:38:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e8a731-abc0-40d5-a2b8-1c0018e4e0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e8a731-abc0-40d5-a2b8-1c0018e4e0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-132079742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9beccbd3-c352-4c11-9ecd-5da7c4a7077b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64afce00cae44f6da12fe57072e08616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:38:32Z,use_quota=True,user_id='be4644ac8afe457bb6c03a9ad4510780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(16e552e6-9330-4400-b3c3-ea32966bc259),volume_type_id=16e552e6-9330-4400-b3c3-ea32966bc259)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c37a0d8-42ba-402c-8d24-7cbeb2420a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c37a0d8-42ba-402c-8d24-7cbeb2420a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b83e2672-9048-463d-b5f7-2bfba4dbe4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b83e2672-9048-463d-b5f7-2bfba4dbe4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9beccbd3-c352-4c11-9ecd-5da7c4a7077b', 'volume_name': 'volume-9beccbd3-c352-4c11-9ecd-5da7c4a7077b', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dcce1ed-6340-4415-aac9-c1a1de00bb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dcce1ed-6340-4415-aac9-c1a1de00bb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f32779-d70c-49a0-b02a-b90eb89c16cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:32 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] Volume 9beccbd3-c352-4c11-9ecd-5da7c4a7077b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9beccbd3-c352-4c11-9ecd-5da7c4a7077b', 'volume_size': 1}
Nov 05 09:38:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:38:33 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:38:33 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Flow 'volume_create_manager' (e2e9e7ec-d30e-42e0-a214-c8a034a2dcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:38:33 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f270992-0f37-42f4-9d67-fd490973c482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:33 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f270992-0f37-42f4-9d67-fd490973c482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1883443729',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045d0cb1-653a-4f17-835a-8779c5639f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64afce00cae44f6da12fe57072e08616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:38:34Z,use_quota=True,user_id='be4644ac8afe457bb6c03a9ad4510780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f285226-1803-4ea5-9348-615385b2d674),volume_type_id=7f285226-1803-4ea5-9348-615385b2d674)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:33 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24b78392-a88f-4502-8ca4-803c0d434a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:33 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24b78392-a88f-4502-8ca4-803c0d434a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:33 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eb129a3-426e-49a5-819d-d150455e7cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:33 devstack cinder-volume[86649]: DEBUG cinder.image.glance [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Creating Keystone auth plugin from conf {{(pid=86649) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 09:38:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eb129a3-426e-49a5-819d-d150455e7cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '045d0cb1-653a-4f17-835a-8779c5639f43', 'volume_name': 'volume-045d0cb1-653a-4f17-835a-8779c5639f43', 'volume_size': 1, 'image_id': 'edb1cb3b-c30c-4604-a7be-ba411c71e452', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edb1cb3b-c30c-4604-a7be-ba411c71e452', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1901105948', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '64afce00cae44f6da12fe57072e08616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'edb1cb3b-c30c-4604-a7be-ba411c71e452', 'created_at': datetime.datetime(2026, 11, 5, 8, 38, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 8, 38, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edb1cb3b-c30c-4604-a7be-ba411c71e452/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7841a676c080>}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc2b559c-02c4-4a95-af0d-c23818e8163e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc2b559c-02c4-4a95-af0d-c23818e8163e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f46388-b587-419c-879f-d70625efb250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:34 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Volume 045d0cb1-653a-4f17-835a-8779c5639f43: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-045d0cb1-653a-4f17-835a-8779c5639f43', 'volume_size': 1, 'image_id': 'edb1cb3b-c30c-4604-a7be-ba411c71e452', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edb1cb3b-c30c-4604-a7be-ba411c71e452', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1901105948', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '64afce00cae44f6da12fe57072e08616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'edb1cb3b-c30c-4604-a7be-ba411c71e452', 'created_at': datetime.datetime(2026, 11, 5, 8, 38, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 8, 38, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edb1cb3b-c30c-4604-a7be-ba411c71e452/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7841a676c080>}
Nov 05 09:38:34 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Trying to clone 045d0cb1-653a-4f17-835a-8779c5639f43 from image edb1cb3b-c30c-4604-a7be-ba411c71e452 at location (None, [{'url': 'file:///opt/stack/data/glance/images/edb1cb3b-c30c-4604-a7be-ba411c71e452', 'metadata': {}}]). {{(pid=86649) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 09:38:34 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-771e8a57-eb0e-493a-8981-0de828189940" returned: 0 in 7.915s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:34 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Image conversion details: src /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720, size 1024.00 MB, duration 7.92 sec, destination /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-771e8a57-eb0e-493a-8981-0de828189940 {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 09:38:34 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Converted 1024.00 MB image at 129.37 MB/s
Nov 05 09:38:34 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-771e8a57-eb0e-493a-8981-0de828189940 is being set with open permissions: ugo+rw
Nov 05 09:38:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-771e8a57-eb0e-493a-8981-0de828189940 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:34 devstack sudo[95900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-771e8a57-eb0e-493a-8981-0de828189940
Nov 05 09:38:34 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:34 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-771e8a57-eb0e-493a-8981-0de828189940" returned: 0 in 0.283s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-quobyte-771e8a57-eb0e-493a-8981-0de828189940" released by "_copy_volume_from_snapshot" :: held 9.195s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:38:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-quobyte-124b1896-4957-4bb7-b2b2-ac38a864f614-771e8a57-eb0e-493a-8981-0de828189940" released by "_create_volume_from_snapshot" :: held 9.282s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:38:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.304s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:38:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.817s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:38:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-957350192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a58e882d-3907-4dfd-a5ff-e56505f592b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64afce00cae44f6da12fe57072e08616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:38:32Z,use_quota=True,user_id='be4644ac8afe457bb6c03a9ad4510780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee9448f4-7401-4d3b-8930-b07d3521ab82),volume_type_id=ee9448f4-7401-4d3b-8930-b07d3521ab82)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:38:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] Creating volume a58e882d-3907-4dfd-a5ff-e56505f592b1 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:38:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:38:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:38:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:38:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:38:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:38:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:38:34 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:38:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a58e882d-3907-4dfd-a5ff-e56505f592b1 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:34 devstack sudo[95903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a58e882d-3907-4dfd-a5ff-e56505f592b1 1073741824
Nov 05 09:38:34 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e5e4cd7-b695-4ea6-81ba-3a45040730e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-771e8a57-eb0e-493a-8981-0de828189940', 'volume_size': 1, 'snapshot_id': '124b1896-4957-4bb7-b2b2-ac38a864f614'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52ab3df-e3ab-4668-bef8-c14f7a11bddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:34 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Volume volume-771e8a57-eb0e-493a-8981-0de828189940 (771e8a57-eb0e-493a-8981-0de828189940): created successfully
Nov 05 09:38:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52ab3df-e3ab-4668-bef8-c14f7a11bddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Flow 'volume_create_manager' (8d7be2e4-b79e-4508-8071-8a888a1a0dd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:38:34 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f0ffecf9-9f2a-4068-af51-d38ec1a68883 tempest-VolumesSnapshotTestJSON-1694161823 None] Created volume successfully.
Nov 05 09:38:35 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a58e882d-3907-4dfd-a5ff-e56505f592b1 1073741824" returned: 0 in 0.469s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a58e882d-3907-4dfd-a5ff-e56505f592b1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:35 devstack sudo[95909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a58e882d-3907-4dfd-a5ff-e56505f592b1
Nov 05 09:38:35 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1f8797a7-8907-4806-9f4f-ffc4b922c4bd tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "cinder-771e8a57-eb0e-493a-8981-0de828189940-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:38:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1f8797a7-8907-4806-9f4f-ffc4b922c4bd tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-771e8a57-eb0e-493a-8981-0de828189940-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:38:35 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a58e882d-3907-4dfd-a5ff-e56505f592b1" returned: 0 in 0.259s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:38:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:38:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.867s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:38:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-132079742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9beccbd3-c352-4c11-9ecd-5da7c4a7077b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64afce00cae44f6da12fe57072e08616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:38:32Z,use_quota=True,user_id='be4644ac8afe457bb6c03a9ad4510780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(16e552e6-9330-4400-b3c3-ea32966bc259),volume_type_id=16e552e6-9330-4400-b3c3-ea32966bc259)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:38:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] Creating volume 9beccbd3-c352-4c11-9ecd-5da7c4a7077b {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:38:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:38:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:38:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:38:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:38:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:38:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:38:35 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:38:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9beccbd3-c352-4c11-9ecd-5da7c4a7077b 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1f8797a7-8907-4806-9f4f-ffc4b922c4bd tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "cinder-quobyte-771e8a57-eb0e-493a-8981-0de828189940" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:38:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1871d553-eb48-48ef-adce-0207f9adf3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a58e882d-3907-4dfd-a5ff-e56505f592b1', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:35 devstack sudo[95912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9beccbd3-c352-4c11-9ecd-5da7c4a7077b 1073741824
Nov 05 09:38:35 devstack sudo[95912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40377430-ce20-421e-8d22-87b874daffd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1f8797a7-8907-4806-9f4f-ffc4b922c4bd tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-quobyte-771e8a57-eb0e-493a-8981-0de828189940" acquired by "delete_volume" :: waited 0.033s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:38:35 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] Volume volume-a58e882d-3907-4dfd-a5ff-e56505f592b1 (a58e882d-3907-4dfd-a5ff-e56505f592b1): created successfully
Nov 05 09:38:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40377430-ce20-421e-8d22-87b874daffd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] Flow 'volume_create_manager' (c2d54365-1c3b-4673-a231-bf74361e6c7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:38:35 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e13fcde-205e-466a-82ff-26c894b4565c]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:38:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1f8797a7-8907-4806-9f4f-ffc4b922c4bd tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-771e8a57-eb0e-493a-8981-0de828189940 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:35 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-907e1d4b-0549-4a03-abe9-52544cc7760f tempest-TestInstancesWithCinderVolumes-333875698 None] Created volume successfully.
Nov 05 09:38:35 devstack sudo[95914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-771e8a57-eb0e-493a-8981-0de828189940
Nov 05 09:38:35 devstack sudo[95914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:36 devstack sudo[95912]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9beccbd3-c352-4c11-9ecd-5da7c4a7077b 1073741824" returned: 0 in 0.528s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:36 devstack sudo[95914]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:36 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=72,cinder:INSERT=20,cinder:UPDATE=86,cinder:DELETE=10 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:38:36 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=81,cinder:INSERT=19,cinder:UPDATE=69,cinder:DELETE=5 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:38:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1f8797a7-8907-4806-9f4f-ffc4b922c4bd tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-771e8a57-eb0e-493a-8981-0de828189940" returned: 0 in 0.439s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1f8797a7-8907-4806-9f4f-ffc4b922c4bd tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-771e8a57-eb0e-493a-8981-0de828189940 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:36 devstack sudo[95927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-771e8a57-eb0e-493a-8981-0de828189940
Nov 05 09:38:36 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9beccbd3-c352-4c11-9ecd-5da7c4a7077b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:36 devstack sudo[95939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9beccbd3-c352-4c11-9ecd-5da7c4a7077b
Nov 05 09:38:36 devstack sudo[95939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:36 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1f8797a7-8907-4806-9f4f-ffc4b922c4bd tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-771e8a57-eb0e-493a-8981-0de828189940" returned: 0 in 0.372s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1f8797a7-8907-4806-9f4f-ffc4b922c4bd tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-quobyte-771e8a57-eb0e-493a-8981-0de828189940" released by "delete_volume" :: held 0.885s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:38:36 devstack sudo[95939]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9beccbd3-c352-4c11-9ecd-5da7c4a7077b" returned: 0 in 0.411s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:38:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:38:36 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-1f8797a7-8907-4806-9f4f-ffc4b922c4bd tempest-VolumesSnapshotTestJSON-1694161823 None] Created reservations ['2c506bce-5192-4455-9ed7-99c5c32d6bd6', 'e3c12755-dc3a-4b44-99e1-27db7709c987', 'd776ff06-7b03-430e-9ffe-f32e03528c98', '8eb9e1fb-a871-48ae-9480-8d35c23ad4e1'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:38:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f32779-d70c-49a0-b02a-b90eb89c16cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9beccbd3-c352-4c11-9ecd-5da7c4a7077b', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71f9215a-1f7b-480f-9405-89daaef6b5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:36 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] Volume volume-9beccbd3-c352-4c11-9ecd-5da7c4a7077b (9beccbd3-c352-4c11-9ecd-5da7c4a7077b): created successfully
Nov 05 09:38:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71f9215a-1f7b-480f-9405-89daaef6b5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] Flow 'volume_create_manager' (48d30bd8-5268-427b-8c4c-b46a6ac6e2f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:38:36 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b453203e-b8b8-4f2e-8e89-76de30ff447e tempest-TestInstancesWithCinderVolumes-333875698 None] Created volume successfully.
Nov 05 09:38:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1f8797a7-8907-4806-9f4f-ffc4b922c4bd tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:38:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1f8797a7-8907-4806-9f4f-ffc4b922c4bd tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:38:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1f8797a7-8907-4806-9f4f-ffc4b922c4bd tempest-VolumesSnapshotTestJSON-1694161823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:38:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1f8797a7-8907-4806-9f4f-ffc4b922c4bd tempest-VolumesSnapshotTestJSON-1694161823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:38:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1f8797a7-8907-4806-9f4f-ffc4b922c4bd tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:38:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1f8797a7-8907-4806-9f4f-ffc4b922c4bd tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:36 devstack sudo[95965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:38:36 devstack sudo[95965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:36 devstack sudo[95965]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1f8797a7-8907-4806-9f4f-ffc4b922c4bd tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.256s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:36 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-1f8797a7-8907-4806-9f4f-ffc4b922c4bd tempest-VolumesSnapshotTestJSON-1694161823 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:38:36 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-1f8797a7-8907-4806-9f4f-ffc4b922c4bd tempest-VolumesSnapshotTestJSON-1694161823 None] Deleted volume successfully.
Nov 05 09:38:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1f8797a7-8907-4806-9f4f-ffc4b922c4bd tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-771e8a57-eb0e-493a-8981-0de828189940-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:38:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b8cc61e1-b94e-4a7d-a0ea-2764ac54f2a8 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "cinder-124b1896-4957-4bb7-b2b2-ac38a864f614-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:38:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b8cc61e1-b94e-4a7d-a0ea-2764ac54f2a8 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-124b1896-4957-4bb7-b2b2-ac38a864f614-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:38:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b8cc61e1-b94e-4a7d-a0ea-2764ac54f2a8 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "cinder-quobyte-30b3a9ae-f529-437e-a2d0-f1bdde678720" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:38:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b8cc61e1-b94e-4a7d-a0ea-2764ac54f2a8 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-quobyte-30b3a9ae-f529-437e-a2d0-f1bdde678720" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:38:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b8cc61e1-b94e-4a7d-a0ea-2764ac54f2a8 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "cinder-quobyte-124b1896-4957-4bb7-b2b2-ac38a864f614" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:38:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b8cc61e1-b94e-4a7d-a0ea-2764ac54f2a8 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-quobyte-124b1896-4957-4bb7-b2b2-ac38a864f614" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:38:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-b8cc61e1-b94e-4a7d-a0ea-2764ac54f2a8 tempest-VolumesSnapshotTestJSON-1694161823 None] Deleting offline snapshot 124b1896-4957-4bb7-b2b2-ac38a864f614 of volume 30b3a9ae-f529-437e-a2d0-f1bdde678720 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 09:38:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-b8cc61e1-b94e-4a7d-a0ea-2764ac54f2a8 tempest-VolumesSnapshotTestJSON-1694161823 None] snapshot_file for this snap is: volume-30b3a9ae-f529-437e-a2d0-f1bdde678720.124b1896-4957-4bb7-b2b2-ac38a864f614 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 09:38:37 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d59c27-16bf-4ccb-a909-96f79f0463c0]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:38:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b8cc61e1-b94e-4a7d-a0ea-2764ac54f2a8 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720.124b1896-4957-4bb7-b2b2-ac38a864f614 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:37 devstack sudo[95968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720.124b1896-4957-4bb7-b2b2-ac38a864f614
Nov 05 09:38:37 devstack sudo[95968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:38 devstack sudo[95968]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b8cc61e1-b94e-4a7d-a0ea-2764ac54f2a8 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720.124b1896-4957-4bb7-b2b2-ac38a864f614" returned: 0 in 0.387s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-b8cc61e1-b94e-4a7d-a0ea-2764ac54f2a8 tempest-VolumesSnapshotTestJSON-1694161823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30b3a9ae-f529-437e-a2d0-f1bdde678720(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:38:38 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f54df0-5dd4-403e-bcd8-0ca4a5fefa67]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:38:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b8cc61e1-b94e-4a7d-a0ea-2764ac54f2a8 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:38 devstack sudo[95973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720
Nov 05 09:38:38 devstack sudo[95973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:38 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_edb1cb3b-c30c-4604-a7be-ba411c71e452_dp_um_f_devstack@QuobyteHD, size 20.69 MB, duration 4.15 sec {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 09:38:38 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Image download 20.69 MB at 4.98 MB/s
Nov 05 09:38:38 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[06006bf6-dc85-4a9a-9b99-accb9ba73883]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:38:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edb1cb3b-c30c-4604-a7be-ba411c71e452_dp_um_f_devstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:38 devstack sudo[95975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edb1cb3b-c30c-4604-a7be-ba411c71e452_dp_um_f_devstack@QuobyteHD
Nov 05 09:38:38 devstack sudo[95975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:38 devstack sudo[95973]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b8cc61e1-b94e-4a7d-a0ea-2764ac54f2a8 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720" returned: 0 in 0.601s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b8cc61e1-b94e-4a7d-a0ea-2764ac54f2a8 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720.124b1896-4957-4bb7-b2b2-ac38a864f614 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:38 devstack sudo[95975]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edb1cb3b-c30c-4604-a7be-ba411c71e452_dp_um_f_devstack@QuobyteHD" returned: 0 in 0.362s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:38 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Temporary image edb1cb3b-c30c-4604-a7be-ba411c71e452 is fetched for user be4644ac8afe457bb6c03a9ad4510780. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 09:38:38 devstack sudo[95983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720.124b1896-4957-4bb7-b2b2-ac38a864f614
Nov 05 09:38:38 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:39 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[0841dcd2-0f67-4c25-b986-cf5122530194]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:38:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edb1cb3b-c30c-4604-a7be-ba411c71e452_dp_um_f_devstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:39 devstack sudo[95986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edb1cb3b-c30c-4604-a7be-ba411c71e452_dp_um_f_devstack@QuobyteHD
Nov 05 09:38:39 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:39 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b8cc61e1-b94e-4a7d-a0ea-2764ac54f2a8 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720.124b1896-4957-4bb7-b2b2-ac38a864f614" returned: 0 in 0.360s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b8cc61e1-b94e-4a7d-a0ea-2764ac54f2a8 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720.124b1896-4957-4bb7-b2b2-ac38a864f614 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:39 devstack sudo[95991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720.124b1896-4957-4bb7-b2b2-ac38a864f614
Nov 05 09:38:39 devstack sudo[95991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:39 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edb1cb3b-c30c-4604-a7be-ba411c71e452_dp_um_f_devstack@QuobyteHD" returned: 0 in 0.347s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:38:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:38:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1883443729',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045d0cb1-653a-4f17-835a-8779c5639f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64afce00cae44f6da12fe57072e08616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:38:34Z,use_quota=True,user_id='be4644ac8afe457bb6c03a9ad4510780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f285226-1803-4ea5-9348-615385b2d674),volume_type_id=7f285226-1803-4ea5-9348-615385b2d674)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:38:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Creating volume 045d0cb1-653a-4f17-835a-8779c5639f43 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:38:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:38:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:38:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:38:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:38:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:38:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:38:39 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:38:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-045d0cb1-653a-4f17-835a-8779c5639f43 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:39 devstack sudo[95996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-045d0cb1-653a-4f17-835a-8779c5639f43 1073741824
Nov 05 09:38:39 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:39 devstack sudo[95991]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b8cc61e1-b94e-4a7d-a0ea-2764ac54f2a8 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720.124b1896-4957-4bb7-b2b2-ac38a864f614" returned: 0 in 0.255s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b8cc61e1-b94e-4a7d-a0ea-2764ac54f2a8 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-quobyte-124b1896-4957-4bb7-b2b2-ac38a864f614" released by "_delete_snapshot" :: held 1.726s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:38:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b8cc61e1-b94e-4a7d-a0ea-2764ac54f2a8 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-quobyte-30b3a9ae-f529-437e-a2d0-f1bdde678720" released by "delete_snapshot" :: held 1.753s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:38:39 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-b8cc61e1-b94e-4a7d-a0ea-2764ac54f2a8 tempest-VolumesSnapshotTestJSON-1694161823 None] Created reservations ['6412f564-3e64-460d-9c4e-96e1b66dcfb1', '5f83dc7e-7729-4d6d-9165-c337c6fef77b', '1d6a2957-0c36-45c3-a5e8-ac40e870b452', '14728407-7f88-4f7f-8063-e65aaa0cc251'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:38:39 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b8cc61e1-b94e-4a7d-a0ea-2764ac54f2a8 tempest-VolumesSnapshotTestJSON-1694161823 None] Delete snapshot completed successfully.
Nov 05 09:38:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b8cc61e1-b94e-4a7d-a0ea-2764ac54f2a8 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-124b1896-4957-4bb7-b2b2-ac38a864f614-delete_snapshot" released by "delete_snapshot" :: held 1.910s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:38:39 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-045d0cb1-653a-4f17-835a-8779c5639f43 1073741824" returned: 0 in 0.479s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-045d0cb1-653a-4f17-835a-8779c5639f43 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:39 devstack sudo[96002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-045d0cb1-653a-4f17-835a-8779c5639f43
Nov 05 09:38:39 devstack sudo[96002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-05de3f92-f4c2-4039-9b9a-d2839a11dd3a tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "cinder-30b3a9ae-f529-437e-a2d0-f1bdde678720-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:38:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-05de3f92-f4c2-4039-9b9a-d2839a11dd3a tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-30b3a9ae-f529-437e-a2d0-f1bdde678720-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:38:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-05de3f92-f4c2-4039-9b9a-d2839a11dd3a tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "cinder-quobyte-30b3a9ae-f529-437e-a2d0-f1bdde678720" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:38:40 devstack sudo[96002]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-045d0cb1-653a-4f17-835a-8779c5639f43" returned: 0 in 0.279s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:38:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:38:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-05de3f92-f4c2-4039-9b9a-d2839a11dd3a tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-quobyte-30b3a9ae-f529-437e-a2d0-f1bdde678720" acquired by "delete_volume" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:38:40 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Attempting download of edb1cb3b-c30c-4604-a7be-ba411c71e452 ((None, [{'url': 'file:///opt/stack/data/glance/images/edb1cb3b-c30c-4604-a7be-ba411c71e452', 'metadata': {}}])) to volume 045d0cb1-653a-4f17-835a-8779c5639f43. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 09:38:40 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba6ba8d-50cf-4075-b3ac-386cef42108d]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:38:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-05de3f92-f4c2-4039-9b9a-d2839a11dd3a tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:40 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3872be-d84b-4afc-81b0-e12550f608e4]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:38:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edb1cb3b-c30c-4604-a7be-ba411c71e452_7khh2d50 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:40 devstack sudo[96005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720
Nov 05 09:38:40 devstack sudo[96005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:40 devstack sudo[96006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edb1cb3b-c30c-4604-a7be-ba411c71e452_7khh2d50
Nov 05 09:38:40 devstack sudo[96006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:40 devstack sudo[96005]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-05de3f92-f4c2-4039-9b9a-d2839a11dd3a tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720" returned: 0 in 0.389s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-05de3f92-f4c2-4039-9b9a-d2839a11dd3a tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:40 devstack sudo[96006]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edb1cb3b-c30c-4604-a7be-ba411c71e452_7khh2d50" returned: 0 in 0.354s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edb1cb3b-c30c-4604-a7be-ba411c71e452_7khh2d50 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:40 devstack sudo[96014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720
Nov 05 09:38:40 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:40 devstack sudo[96015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edb1cb3b-c30c-4604-a7be-ba411c71e452_7khh2d50
Nov 05 09:38:40 devstack sudo[96015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:40 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-05de3f92-f4c2-4039-9b9a-d2839a11dd3a tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-30b3a9ae-f529-437e-a2d0-f1bdde678720" returned: 0 in 0.293s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-05de3f92-f4c2-4039-9b9a-d2839a11dd3a tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-quobyte-30b3a9ae-f529-437e-a2d0-f1bdde678720" released by "delete_volume" :: held 0.764s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:38:40 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-05de3f92-f4c2-4039-9b9a-d2839a11dd3a tempest-VolumesSnapshotTestJSON-1694161823 None] Created reservations ['3fcf707f-da1f-422d-91a9-88bff7641785', '802ea0a8-adae-4817-adef-a663513086ee', '49ba8577-5a06-4c91-9299-3a78151b2c22', '7d134f5a-3867-491f-888d-3e1447deaeb9'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:38:41 devstack sudo[96015]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edb1cb3b-c30c-4604-a7be-ba411c71e452_7khh2d50" returned: 1 in 0.376s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edb1cb3b-c30c-4604-a7be-ba411c71e452_7khh2d50' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 09:38:41 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9577a8-4eb2-4f68-94a7-081333928ada]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:38:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edb1cb3b-c30c-4604-a7be-ba411c71e452_dp_um_f_devstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-05de3f92-f4c2-4039-9b9a-d2839a11dd3a tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:38:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-05de3f92-f4c2-4039-9b9a-d2839a11dd3a tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:38:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-05de3f92-f4c2-4039-9b9a-d2839a11dd3a tempest-VolumesSnapshotTestJSON-1694161823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:38:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-05de3f92-f4c2-4039-9b9a-d2839a11dd3a tempest-VolumesSnapshotTestJSON-1694161823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:38:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-05de3f92-f4c2-4039-9b9a-d2839a11dd3a tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:38:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-05de3f92-f4c2-4039-9b9a-d2839a11dd3a tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:41 devstack sudo[96028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:38:41 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:41 devstack sudo[96027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edb1cb3b-c30c-4604-a7be-ba411c71e452_dp_um_f_devstack@QuobyteHD
Nov 05 09:38:41 devstack sudo[96027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-643c5532-6b2a-4ef5-b736-8459c1a82e22 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "cinder-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:38:41 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-05de3f92-f4c2-4039-9b9a-d2839a11dd3a tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.287s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:41 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-05de3f92-f4c2-4039-9b9a-d2839a11dd3a tempest-VolumesSnapshotTestJSON-1694161823 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:38:41 devstack sudo[96027]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-643c5532-6b2a-4ef5-b736-8459c1a82e22 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:38:41 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-05de3f92-f4c2-4039-9b9a-d2839a11dd3a tempest-VolumesSnapshotTestJSON-1694161823 None] Deleted volume successfully.
Nov 05 09:38:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edb1cb3b-c30c-4604-a7be-ba411c71e452_dp_um_f_devstack@QuobyteHD" returned: 0 in 0.378s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:41 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] edb1cb3b-c30c-4604-a7be-ba411c71e452 was qcow2, converting to qcow2 {{(pid=86649) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 09:38:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_edb1cb3b-c30c-4604-a7be-ba411c71e452_dp_um_f_devstack@QuobyteHD /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-045d0cb1-653a-4f17-835a-8779c5639f43 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:41 devstack sudo[96035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_edb1cb3b-c30c-4604-a7be-ba411c71e452_dp_um_f_devstack@QuobyteHD /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-045d0cb1-653a-4f17-835a-8779c5639f43
Nov 05 09:38:41 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-05de3f92-f4c2-4039-9b9a-d2839a11dd3a tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-30b3a9ae-f529-437e-a2d0-f1bdde678720-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:38:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-643c5532-6b2a-4ef5-b736-8459c1a82e22 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "cinder-quobyte-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:38:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-643c5532-6b2a-4ef5-b736-8459c1a82e22 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-quobyte-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad" acquired by "delete_volume" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:38:41 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba1ef21-3f91-40e3-9a14-03183993df46]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:38:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-643c5532-6b2a-4ef5-b736-8459c1a82e22 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:41 devstack sudo[96039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad
Nov 05 09:38:41 devstack sudo[96039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:42 devstack sudo[96039]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-643c5532-6b2a-4ef5-b736-8459c1a82e22 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad" returned: 0 in 0.480s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-643c5532-6b2a-4ef5-b736-8459c1a82e22 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:42 devstack sudo[96068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad
Nov 05 09:38:42 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:42 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-643c5532-6b2a-4ef5-b736-8459c1a82e22 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad" returned: 0 in 0.316s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-643c5532-6b2a-4ef5-b736-8459c1a82e22 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-quobyte-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad" released by "delete_volume" :: held 0.871s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:38:42 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-643c5532-6b2a-4ef5-b736-8459c1a82e22 tempest-VolumesSnapshotTestJSON-1694161823 None] Created reservations ['6ce98099-234f-475b-94d0-2558b7c5d412', '745841dc-d8c2-44d7-b719-98e655c31d9d', 'd9e0caff-5b45-4d03-a1c8-7b2a04b26780', 'fe8ecdcb-4eef-461a-aa19-782982dbb705'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:38:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-643c5532-6b2a-4ef5-b736-8459c1a82e22 tempest-VolumesSnapshotTestJSON-1694161823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:38:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-643c5532-6b2a-4ef5-b736-8459c1a82e22 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:38:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-643c5532-6b2a-4ef5-b736-8459c1a82e22 tempest-VolumesSnapshotTestJSON-1694161823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:38:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-643c5532-6b2a-4ef5-b736-8459c1a82e22 tempest-VolumesSnapshotTestJSON-1694161823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:38:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-643c5532-6b2a-4ef5-b736-8459c1a82e22 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:38:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-643c5532-6b2a-4ef5-b736-8459c1a82e22 tempest-VolumesSnapshotTestJSON-1694161823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:42 devstack sudo[96071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:38:42 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:42 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-643c5532-6b2a-4ef5-b736-8459c1a82e22 tempest-VolumesSnapshotTestJSON-1694161823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.326s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:42 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-643c5532-6b2a-4ef5-b736-8459c1a82e22 tempest-VolumesSnapshotTestJSON-1694161823 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:38:42 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-643c5532-6b2a-4ef5-b736-8459c1a82e22 tempest-VolumesSnapshotTestJSON-1694161823 None] Deleted volume successfully.
Nov 05 09:38:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-643c5532-6b2a-4ef5-b736-8459c1a82e22 tempest-VolumesSnapshotTestJSON-1694161823 None] Lock "cinder-b7a72e7c-b8d7-4753-b6a9-931c9346f8ad-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:38:43 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_edb1cb3b-c30c-4604-a7be-ba411c71e452_dp_um_f_devstack@QuobyteHD /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-045d0cb1-653a-4f17-835a-8779c5639f43" returned: 0 in 2.424s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:43 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_edb1cb3b-c30c-4604-a7be-ba411c71e452_dp_um_f_devstack@QuobyteHD, size 112.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-045d0cb1-653a-4f17-835a-8779c5639f43 {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 09:38:43 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Converted 112.00 MB image at 46.19 MB/s
Nov 05 09:38:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-045d0cb1-653a-4f17-835a-8779c5639f43 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:38:43 devstack sudo[96076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-045d0cb1-653a-4f17-835a-8779c5639f43 1G
Nov 05 09:38:43 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:38:44 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root
Nov 05 09:38:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-045d0cb1-653a-4f17-835a-8779c5639f43 1G" returned: 0 in 0.344s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:38:44 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Downloaded image edb1cb3b-c30c-4604-a7be-ba411c71e452 ((None, [{'url': 'file:///opt/stack/data/glance/images/edb1cb3b-c30c-4604-a7be-ba411c71e452', 'metadata': {}}])) to volume 045d0cb1-653a-4f17-835a-8779c5639f43 successfully. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 09:38:44 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Temporary image edb1cb3b-c30c-4604-a7be-ba411c71e452 for user be4644ac8afe457bb6c03a9ad4510780 is deleted. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 09:38:44 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Marking volume 045d0cb1-653a-4f17-835a-8779c5639f43 as bootable. {{(pid=86649) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 09:38:44 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Copying metadata from image edb1cb3b-c30c-4604-a7be-ba411c71e452 to 045d0cb1-653a-4f17-835a-8779c5639f43. {{(pid=86649) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 09:38:44 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Creating volume glance metadata for volume 045d0cb1-653a-4f17-835a-8779c5639f43 backed by image edb1cb3b-c30c-4604-a7be-ba411c71e452 with: {'image_id': 'edb1cb3b-c30c-4604-a7be-ba411c71e452', 'image_name': 'tempest-scenario-img--1901105948', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86649) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 09:38:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f46388-b587-419c-879f-d70625efb250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-045d0cb1-653a-4f17-835a-8779c5639f43', 'volume_size': 1, 'image_id': 'edb1cb3b-c30c-4604-a7be-ba411c71e452', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edb1cb3b-c30c-4604-a7be-ba411c71e452', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1901105948', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '64afce00cae44f6da12fe57072e08616', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'edb1cb3b-c30c-4604-a7be-ba411c71e452', 'created_at': datetime.datetime(2026, 11, 5, 8, 38, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 8, 38, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edb1cb3b-c30c-4604-a7be-ba411c71e452/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7841a676c080>}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69c8fbc-e88d-4b1f-87be-0e1bfe5d58a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:38:44 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Volume volume-045d0cb1-653a-4f17-835a-8779c5639f43 (045d0cb1-653a-4f17-835a-8779c5639f43): created successfully
Nov 05 09:38:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69c8fbc-e88d-4b1f-87be-0e1bfe5d58a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:38:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Flow 'volume_create_manager' (e2e9e7ec-d30e-42e0-a214-c8a034a2dcda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:38:44 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-75111805-fc19-48f9-bd10-0c8fe9d59636 tempest-TestInstancesWithCinderVolumes-333875698 None] Created volume successfully.
Nov 05 09:38:54 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=22,cinder:INSERT=19,cinder:UPDATE=35,cinder:DELETE=3 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:38:54 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=31,cinder:INSERT=8,cinder:UPDATE=35,cinder:DELETE=2 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:38:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-30bb3c2c-43e0-4e4d-b24c-c7a6e14438e7 req-99c1ad1c-987d-4a40-aab9-ceccb73542fc tempest-TestInstancesWithCinderVolumes-333875698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:38:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-30bb3c2c-43e0-4e4d-b24c-c7a6e14438e7 req-99c1ad1c-987d-4a40-aab9-ceccb73542fc tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:38:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-30bb3c2c-43e0-4e4d-b24c-c7a6e14438e7 req-99c1ad1c-987d-4a40-aab9-ceccb73542fc tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:38:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-30bb3c2c-43e0-4e4d-b24c-c7a6e14438e7 req-99c1ad1c-987d-4a40-aab9-ceccb73542fc tempest-TestInstancesWithCinderVolumes-333875698 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1', 'name': 'volume-045d0cb1-653a-4f17-835a-8779c5639f43', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6bfdcb30-43e0-4023-9d6e-338acbbce4ee', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 09:38:55 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-30bb3c2c-43e0-4e4d-b24c-c7a6e14438e7 req-99c1ad1c-987d-4a40-aab9-ceccb73542fc tempest-TestInstancesWithCinderVolumes-333875698 None] attachment_update completed successfully.
Nov 05 09:39:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:39:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:39:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:39:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:39:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:39:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:39:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:39:00 devstack sudo[96101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:39:00 devstack sudo[96101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:39:00 devstack sudo[96101]: pam_unix(sudo:session): session closed for user root
Nov 05 09:39:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.261s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:39:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:39:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:39:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 28 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:39:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>, <Thread(tpool_thread_0, started daemon 132223357408960)>, <Thread(tpool_thread_1, started daemon 132223349016256)>, <Thread(tpool_thread_2, started daemon 132223340623552)>, <Thread(tpool_thread_3, started daemon 132223332230848)>, <Thread(tpool_thread_4, started daemon 132223323838144)>, <Thread(tpool_thread_5, started daemon 132223315445440)>, <Thread(tpool_thread_6, started daemon 132223307052736)>, <Thread(tpool_thread_7, started daemon 132223298660032)>, <Thread(tpool_thread_8, started daemon 132223290250944)>, <Thread(tpool_thread_9, started daemon 132223281841856)>, <Thread(tpool_thread_10, started daemon 132223273432768)>, <Thread(tpool_thread_11, started daemon 132223265023680)>, <Thread(tpool_thread_12, started daemon 132223256614592)>, <Thread(tpool_thread_13, started daemon 132223248205504)>, <Thread(tpool_thread_14, started daemon 132223239796416)>, <Thread(tpool_thread_15, started daemon 132223231387328)>, <Thread(tpool_thread_16, started daemon 132223222978240)>, <Thread(tpool_thread_17, started daemon 132223214569152)>, <Thread(tpool_thread_18, started daemon 132223206160064)>, <Thread(tpool_thread_19, started daemon 132223197750976)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:39:06 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:39:06 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:39:06 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:39:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] Flow 'volume_create_manager' (b7ac1543-ae0b-45eb-8855-370cd29e0805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:39:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2b71d7d-dd0f-4dae-a75b-7dfae028f74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:39:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2b71d7d-dd0f-4dae-a75b-7dfae028f74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1972197454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41c46f7d64484f36ab72c82f02166fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:39:06Z,use_quota=True,user_id='378ac17a44784029ac768ab1330503c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:39:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d46145d-adc2-4b92-88f2-8218dae217ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:39:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d46145d-adc2-4b92-88f2-8218dae217ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:39:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (283fc211-b939-47a8-aaac-3f68c2c91159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:39:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (283fc211-b939-47a8-aaac-3f68c2c91159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6', 'volume_name': 'volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:39:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a115c78e-7620-4da1-8a02-4f20416faaee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:39:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a115c78e-7620-4da1-8a02-4f20416faaee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:39:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a412e9e-6a2a-4a81-817c-50ada98964db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:39:06 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] Volume c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6', 'volume_size': 1}
Nov 05 09:39:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:39:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:39:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1972197454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41c46f7d64484f36ab72c82f02166fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:39:06Z,use_quota=True,user_id='378ac17a44784029ac768ab1330503c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:39:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] Creating volume c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:39:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:39:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:39:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:39:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:39:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:39:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:39:06 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:39:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:39:06 devstack sudo[96564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6 1073741824
Nov 05 09:39:06 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:39:07 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root
Nov 05 09:39:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6 1073741824" returned: 0 in 0.665s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:39:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:39:07 devstack sudo[96595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6
Nov 05 09:39:07 devstack sudo[96595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:39:07 devstack sudo[96595]: pam_unix(sudo:session): session closed for user root
Nov 05 09:39:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6" returned: 0 in 0.315s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:39:07 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:39:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:39:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a412e9e-6a2a-4a81-817c-50ada98964db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:39:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907d51e1-8ef8-4c35-88cf-dd8dd1c4bc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:39:07 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] Volume volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6 (c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6): created successfully
Nov 05 09:39:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907d51e1-8ef8-4c35-88cf-dd8dd1c4bc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:39:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] Flow 'volume_create_manager' (b7ac1543-ae0b-45eb-8855-370cd29e0805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:39:07 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-0b431ba2-bdda-49c9-b1a2-ed525e06a2ef req-667ca9db-5ee4-4991-9881-c43d875de173 tempest-VolumesSnapshotsTestJSON-2055334057 None] Created volume successfully.
Nov 05 09:39:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-57876da1-f981-4557-8a63-a8b01ca6f6a1 req-2b009369-704f-488b-acea-6657ae4aedba tempest-VolumesSnapshotsTestJSON-2055334057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:39:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-57876da1-f981-4557-8a63-a8b01ca6f6a1 req-2b009369-704f-488b-acea-6657ae4aedba tempest-VolumesSnapshotsTestJSON-2055334057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:39:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [req-57876da1-f981-4557-8a63-a8b01ca6f6a1 req-2b009369-704f-488b-acea-6657ae4aedba tempest-VolumesSnapshotsTestJSON-2055334057 None] Creating offline snapshot eae9ae9b-818a-4d85-8f1e-f26fccccf7c1 of volume c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 09:39:10 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bf688b-bab7-450c-97a1-cffeba43fb03]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:39:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-57876da1-f981-4557-8a63-a8b01ca6f6a1 req-2b009369-704f-488b-acea-6657ae4aedba tempest-VolumesSnapshotsTestJSON-2055334057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:39:10 devstack sudo[96603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6
Nov 05 09:39:10 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:39:11 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root
Nov 05 09:39:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-57876da1-f981-4557-8a63-a8b01ca6f6a1 req-2b009369-704f-488b-acea-6657ae4aedba tempest-VolumesSnapshotsTestJSON-2055334057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6" returned: 0 in 0.590s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:39:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-57876da1-f981-4557-8a63-a8b01ca6f6a1 req-2b009369-704f-488b-acea-6657ae4aedba tempest-VolumesSnapshotsTestJSON-2055334057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6.eae9ae9b-818a-4d85-8f1e-f26fccccf7c1 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:39:11 devstack sudo[96608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6.eae9ae9b-818a-4d85-8f1e-f26fccccf7c1 1G
Nov 05 09:39:11 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:39:11 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root
Nov 05 09:39:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-57876da1-f981-4557-8a63-a8b01ca6f6a1 req-2b009369-704f-488b-acea-6657ae4aedba tempest-VolumesSnapshotsTestJSON-2055334057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6.eae9ae9b-818a-4d85-8f1e-f26fccccf7c1 1G" returned: 0 in 0.515s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:39:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-57876da1-f981-4557-8a63-a8b01ca6f6a1 req-2b009369-704f-488b-acea-6657ae4aedba tempest-VolumesSnapshotsTestJSON-2055334057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6.eae9ae9b-818a-4d85-8f1e-f26fccccf7c1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:39:11 devstack sudo[96615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6.eae9ae9b-818a-4d85-8f1e-f26fccccf7c1
Nov 05 09:39:11 devstack sudo[96615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:39:11 devstack sudo[96615]: pam_unix(sudo:session): session closed for user root
Nov 05 09:39:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-57876da1-f981-4557-8a63-a8b01ca6f6a1 req-2b009369-704f-488b-acea-6657ae4aedba tempest-VolumesSnapshotsTestJSON-2055334057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6.eae9ae9b-818a-4d85-8f1e-f26fccccf7c1" returned: 0 in 0.340s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:39:11 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [req-57876da1-f981-4557-8a63-a8b01ca6f6a1 req-2b009369-704f-488b-acea-6657ae4aedba tempest-VolumesSnapshotsTestJSON-2055334057 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6.eae9ae9b-818a-4d85-8f1e-f26fccccf7c1 is being set with open permissions: ugo+rw
Nov 05 09:39:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-57876da1-f981-4557-8a63-a8b01ca6f6a1 req-2b009369-704f-488b-acea-6657ae4aedba tempest-VolumesSnapshotsTestJSON-2055334057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6.eae9ae9b-818a-4d85-8f1e-f26fccccf7c1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:39:11 devstack sudo[96621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6.eae9ae9b-818a-4d85-8f1e-f26fccccf7c1
Nov 05 09:39:11 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:39:12 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root
Nov 05 09:39:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-57876da1-f981-4557-8a63-a8b01ca6f6a1 req-2b009369-704f-488b-acea-6657ae4aedba tempest-VolumesSnapshotsTestJSON-2055334057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6.eae9ae9b-818a-4d85-8f1e-f26fccccf7c1" returned: 0 in 0.271s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:39:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-57876da1-f981-4557-8a63-a8b01ca6f6a1 req-2b009369-704f-488b-acea-6657ae4aedba tempest-VolumesSnapshotsTestJSON-2055334057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:39:12 devstack sudo[96624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6.info
Nov 05 09:39:12 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:39:12 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root
Nov 05 09:39:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-57876da1-f981-4557-8a63-a8b01ca6f6a1 req-2b009369-704f-488b-acea-6657ae4aedba tempest-VolumesSnapshotsTestJSON-2055334057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6.info" returned: 0 in 0.419s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:39:12 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [req-57876da1-f981-4557-8a63-a8b01ca6f6a1 req-2b009369-704f-488b-acea-6657ae4aedba tempest-VolumesSnapshotsTestJSON-2055334057 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6.info is being set with open permissions: ugo+rw
Nov 05 09:39:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-57876da1-f981-4557-8a63-a8b01ca6f6a1 req-2b009369-704f-488b-acea-6657ae4aedba tempest-VolumesSnapshotsTestJSON-2055334057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:39:12 devstack sudo[96627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6.info
Nov 05 09:39:12 devstack sudo[96627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:39:13 devstack sudo[96627]: pam_unix(sudo:session): session closed for user root
Nov 05 09:39:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-57876da1-f981-4557-8a63-a8b01ca6f6a1 req-2b009369-704f-488b-acea-6657ae4aedba tempest-VolumesSnapshotsTestJSON-2055334057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6.info" returned: 0 in 0.354s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:39:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-57876da1-f981-4557-8a63-a8b01ca6f6a1 req-2b009369-704f-488b-acea-6657ae4aedba tempest-VolumesSnapshotsTestJSON-2055334057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.631s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:39:13 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-57876da1-f981-4557-8a63-a8b01ca6f6a1 req-2b009369-704f-488b-acea-6657ae4aedba tempest-VolumesSnapshotsTestJSON-2055334057 None] Create snapshot completed successfully
Nov 05 09:39:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-8bd9a12f-5fd0-4e54-a00e-3a974fd55cbf req-c02944ca-4e6d-4c86-bb10-4ce170d84172 tempest-VolumesSnapshotsTestJSON-2055334057 None] Acquiring lock "cinder-eae9ae9b-818a-4d85-8f1e-f26fccccf7c1-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:39:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-8bd9a12f-5fd0-4e54-a00e-3a974fd55cbf req-c02944ca-4e6d-4c86-bb10-4ce170d84172 tempest-VolumesSnapshotsTestJSON-2055334057 None] Lock "cinder-eae9ae9b-818a-4d85-8f1e-f26fccccf7c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:39:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-8bd9a12f-5fd0-4e54-a00e-3a974fd55cbf req-c02944ca-4e6d-4c86-bb10-4ce170d84172 tempest-VolumesSnapshotsTestJSON-2055334057 None] Acquiring lock "cinder-quobyte-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:39:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-8bd9a12f-5fd0-4e54-a00e-3a974fd55cbf req-c02944ca-4e6d-4c86-bb10-4ce170d84172 tempest-VolumesSnapshotsTestJSON-2055334057 None] Lock "cinder-quobyte-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:39:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-8bd9a12f-5fd0-4e54-a00e-3a974fd55cbf req-c02944ca-4e6d-4c86-bb10-4ce170d84172 tempest-VolumesSnapshotsTestJSON-2055334057 None] Acquiring lock "cinder-quobyte-eae9ae9b-818a-4d85-8f1e-f26fccccf7c1" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:39:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-8bd9a12f-5fd0-4e54-a00e-3a974fd55cbf req-c02944ca-4e6d-4c86-bb10-4ce170d84172 tempest-VolumesSnapshotsTestJSON-2055334057 None] Lock "cinder-quobyte-eae9ae9b-818a-4d85-8f1e-f26fccccf7c1" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:39:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [req-8bd9a12f-5fd0-4e54-a00e-3a974fd55cbf req-c02944ca-4e6d-4c86-bb10-4ce170d84172 tempest-VolumesSnapshotsTestJSON-2055334057 None] Deleting offline snapshot eae9ae9b-818a-4d85-8f1e-f26fccccf7c1 of volume c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 09:39:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [req-8bd9a12f-5fd0-4e54-a00e-3a974fd55cbf req-c02944ca-4e6d-4c86-bb10-4ce170d84172 tempest-VolumesSnapshotsTestJSON-2055334057 None] snapshot_file for this snap is: volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6.eae9ae9b-818a-4d85-8f1e-f26fccccf7c1 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 09:39:18 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4c6f69-20b7-45bb-b1a0-2a74ba43a22e]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:39:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-8bd9a12f-5fd0-4e54-a00e-3a974fd55cbf req-c02944ca-4e6d-4c86-bb10-4ce170d84172 tempest-VolumesSnapshotsTestJSON-2055334057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6.eae9ae9b-818a-4d85-8f1e-f26fccccf7c1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:39:18 devstack sudo[96630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6.eae9ae9b-818a-4d85-8f1e-f26fccccf7c1
Nov 05 09:39:18 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:39:18 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root
Nov 05 09:39:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-8bd9a12f-5fd0-4e54-a00e-3a974fd55cbf req-c02944ca-4e6d-4c86-bb10-4ce170d84172 tempest-VolumesSnapshotsTestJSON-2055334057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6.eae9ae9b-818a-4d85-8f1e-f26fccccf7c1" returned: 0 in 0.438s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:39:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [req-8bd9a12f-5fd0-4e54-a00e-3a974fd55cbf req-c02944ca-4e6d-4c86-bb10-4ce170d84172 tempest-VolumesSnapshotsTestJSON-2055334057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:39:18 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[107151ab-257c-40c9-943b-7199af60acb4]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:39:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-8bd9a12f-5fd0-4e54-a00e-3a974fd55cbf req-c02944ca-4e6d-4c86-bb10-4ce170d84172 tempest-VolumesSnapshotsTestJSON-2055334057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:39:18 devstack sudo[96635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6
Nov 05 09:39:18 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:39:19 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root
Nov 05 09:39:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-8bd9a12f-5fd0-4e54-a00e-3a974fd55cbf req-c02944ca-4e6d-4c86-bb10-4ce170d84172 tempest-VolumesSnapshotsTestJSON-2055334057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6" returned: 0 in 0.418s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:39:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-8bd9a12f-5fd0-4e54-a00e-3a974fd55cbf req-c02944ca-4e6d-4c86-bb10-4ce170d84172 tempest-VolumesSnapshotsTestJSON-2055334057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6.eae9ae9b-818a-4d85-8f1e-f26fccccf7c1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:39:19 devstack sudo[96641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6.eae9ae9b-818a-4d85-8f1e-f26fccccf7c1
Nov 05 09:39:19 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:39:19 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root
Nov 05 09:39:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-8bd9a12f-5fd0-4e54-a00e-3a974fd55cbf req-c02944ca-4e6d-4c86-bb10-4ce170d84172 tempest-VolumesSnapshotsTestJSON-2055334057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6.eae9ae9b-818a-4d85-8f1e-f26fccccf7c1" returned: 0 in 0.368s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:39:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-8bd9a12f-5fd0-4e54-a00e-3a974fd55cbf req-c02944ca-4e6d-4c86-bb10-4ce170d84172 tempest-VolumesSnapshotsTestJSON-2055334057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6.eae9ae9b-818a-4d85-8f1e-f26fccccf7c1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:39:19 devstack sudo[96646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6.eae9ae9b-818a-4d85-8f1e-f26fccccf7c1
Nov 05 09:39:19 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:39:19 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root
Nov 05 09:39:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-8bd9a12f-5fd0-4e54-a00e-3a974fd55cbf req-c02944ca-4e6d-4c86-bb10-4ce170d84172 tempest-VolumesSnapshotsTestJSON-2055334057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6.eae9ae9b-818a-4d85-8f1e-f26fccccf7c1" returned: 0 in 0.273s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:39:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-8bd9a12f-5fd0-4e54-a00e-3a974fd55cbf req-c02944ca-4e6d-4c86-bb10-4ce170d84172 tempest-VolumesSnapshotsTestJSON-2055334057 None] Lock "cinder-quobyte-eae9ae9b-818a-4d85-8f1e-f26fccccf7c1" released by "_delete_snapshot" :: held 1.660s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:39:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-8bd9a12f-5fd0-4e54-a00e-3a974fd55cbf req-c02944ca-4e6d-4c86-bb10-4ce170d84172 tempest-VolumesSnapshotsTestJSON-2055334057 None] Lock "cinder-quobyte-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6" released by "delete_snapshot" :: held 1.694s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:39:19 devstack cinder-volume[86649]: DEBUG cinder.quota [req-8bd9a12f-5fd0-4e54-a00e-3a974fd55cbf req-c02944ca-4e6d-4c86-bb10-4ce170d84172 tempest-VolumesSnapshotsTestJSON-2055334057 None] Created reservations ['2c1ce447-48c3-47e5-adf7-371cb888837c', '3ea332fe-7adb-4806-8381-c9dd702c443d', '93263bdb-2d02-4b9c-a54a-eb3b0eb4c47a', '9405d1f3-bead-486a-94ea-99aa73e65e4f'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:39:20 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-8bd9a12f-5fd0-4e54-a00e-3a974fd55cbf req-c02944ca-4e6d-4c86-bb10-4ce170d84172 tempest-VolumesSnapshotsTestJSON-2055334057 None] Delete snapshot completed successfully.
Nov 05 09:39:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-8bd9a12f-5fd0-4e54-a00e-3a974fd55cbf req-c02944ca-4e6d-4c86-bb10-4ce170d84172 tempest-VolumesSnapshotsTestJSON-2055334057 None] Lock "cinder-eae9ae9b-818a-4d85-8f1e-f26fccccf7c1-delete_snapshot" released by "delete_snapshot" :: held 1.923s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:39:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-24a81b8d-266d-41fa-a0b3-7941f30eb73a req-c0744667-bcce-4f93-b9ac-99052ba0536e tempest-VolumesSnapshotsTestJSON-2055334057 None] Acquiring lock "cinder-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:39:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-24a81b8d-266d-41fa-a0b3-7941f30eb73a req-c0744667-bcce-4f93-b9ac-99052ba0536e tempest-VolumesSnapshotsTestJSON-2055334057 None] Lock "cinder-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:39:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-24a81b8d-266d-41fa-a0b3-7941f30eb73a req-c0744667-bcce-4f93-b9ac-99052ba0536e tempest-VolumesSnapshotsTestJSON-2055334057 None] Acquiring lock "cinder-quobyte-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:39:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-24a81b8d-266d-41fa-a0b3-7941f30eb73a req-c0744667-bcce-4f93-b9ac-99052ba0536e tempest-VolumesSnapshotsTestJSON-2055334057 None] Lock "cinder-quobyte-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6" acquired by "delete_volume" :: waited 0.026s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:39:20 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d880db7-2d44-440f-a061-892705dd7383]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:39:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-24a81b8d-266d-41fa-a0b3-7941f30eb73a req-c0744667-bcce-4f93-b9ac-99052ba0536e tempest-VolumesSnapshotsTestJSON-2055334057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:39:20 devstack sudo[96651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6
Nov 05 09:39:20 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:39:21 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root
Nov 05 09:39:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-24a81b8d-266d-41fa-a0b3-7941f30eb73a req-c0744667-bcce-4f93-b9ac-99052ba0536e tempest-VolumesSnapshotsTestJSON-2055334057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6" returned: 0 in 0.448s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:39:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-24a81b8d-266d-41fa-a0b3-7941f30eb73a req-c0744667-bcce-4f93-b9ac-99052ba0536e tempest-VolumesSnapshotsTestJSON-2055334057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:39:21 devstack sudo[96656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6
Nov 05 09:39:21 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:39:21 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root
Nov 05 09:39:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-24a81b8d-266d-41fa-a0b3-7941f30eb73a req-c0744667-bcce-4f93-b9ac-99052ba0536e tempest-VolumesSnapshotsTestJSON-2055334057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6" returned: 0 in 0.271s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:39:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-24a81b8d-266d-41fa-a0b3-7941f30eb73a req-c0744667-bcce-4f93-b9ac-99052ba0536e tempest-VolumesSnapshotsTestJSON-2055334057 None] Lock "cinder-quobyte-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6" released by "delete_volume" :: held 0.804s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:39:21 devstack cinder-volume[86649]: DEBUG cinder.quota [req-24a81b8d-266d-41fa-a0b3-7941f30eb73a req-c0744667-bcce-4f93-b9ac-99052ba0536e tempest-VolumesSnapshotsTestJSON-2055334057 None] Created reservations ['83a2f233-5dad-4703-ac73-1d6832cc062c', '1288efa7-3806-47c5-9ea0-134aeb073c8f', 'de1d4e1b-ab4d-4e02-8f60-276c37752e33', '38288608-c599-4f68-a17d-150f639e3d18'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:39:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-24a81b8d-266d-41fa-a0b3-7941f30eb73a req-c0744667-bcce-4f93-b9ac-99052ba0536e tempest-VolumesSnapshotsTestJSON-2055334057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:39:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-24a81b8d-266d-41fa-a0b3-7941f30eb73a req-c0744667-bcce-4f93-b9ac-99052ba0536e tempest-VolumesSnapshotsTestJSON-2055334057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:39:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [req-24a81b8d-266d-41fa-a0b3-7941f30eb73a req-c0744667-bcce-4f93-b9ac-99052ba0536e tempest-VolumesSnapshotsTestJSON-2055334057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:39:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [req-24a81b8d-266d-41fa-a0b3-7941f30eb73a req-c0744667-bcce-4f93-b9ac-99052ba0536e tempest-VolumesSnapshotsTestJSON-2055334057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:39:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-24a81b8d-266d-41fa-a0b3-7941f30eb73a req-c0744667-bcce-4f93-b9ac-99052ba0536e tempest-VolumesSnapshotsTestJSON-2055334057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:39:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-24a81b8d-266d-41fa-a0b3-7941f30eb73a req-c0744667-bcce-4f93-b9ac-99052ba0536e tempest-VolumesSnapshotsTestJSON-2055334057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:39:21 devstack sudo[96659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:39:21 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:39:21 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root
Nov 05 09:39:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-24a81b8d-266d-41fa-a0b3-7941f30eb73a req-c0744667-bcce-4f93-b9ac-99052ba0536e tempest-VolumesSnapshotsTestJSON-2055334057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.329s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:39:21 devstack cinder-volume[86649]: DEBUG cinder.manager [req-24a81b8d-266d-41fa-a0b3-7941f30eb73a req-c0744667-bcce-4f93-b9ac-99052ba0536e tempest-VolumesSnapshotsTestJSON-2055334057 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:39:21 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-24a81b8d-266d-41fa-a0b3-7941f30eb73a req-c0744667-bcce-4f93-b9ac-99052ba0536e tempest-VolumesSnapshotsTestJSON-2055334057 None] Deleted volume successfully.
Nov 05 09:39:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-24a81b8d-266d-41fa-a0b3-7941f30eb73a req-c0744667-bcce-4f93-b9ac-99052ba0536e tempest-VolumesSnapshotsTestJSON-2055334057 None] Lock "cinder-c4cdbd8e-1ac4-45a9-8b6b-04b769880ae6-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] Flow 'volume_create_manager' (591f62b4-8500-443c-95dd-19ae3570c856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff75058e-f9a7-45f9-a9e1-ebed13a5f0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff75058e-f9a7-45f9-a9e1-ebed13a5f0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-595494073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc99933d-2872-4c76-9568-71e9caeca2b9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6c4df33d790c40d6bcefe4803f3910f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:39:29Z,use_quota=True,user_id='2cc47b3bf28d47c69326602b06aa3fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb22ba1-0bfd-4321-80f6-a89c590521e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb22ba1-0bfd-4321-80f6-a89c590521e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2902c46e-0441-42a1-b2b4-559097e01d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2902c46e-0441-42a1-b2b4-559097e01d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc99933d-2872-4c76-9568-71e9caeca2b9', 'volume_name': 'volume-dc99933d-2872-4c76-9568-71e9caeca2b9', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4b2e029-e0e2-4560-b273-aec0091aee21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4b2e029-e0e2-4560-b273-aec0091aee21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6609559e-247f-4dc3-94f3-81e3ac69eed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:39:28 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] Volume dc99933d-2872-4c76-9568-71e9caeca2b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc99933d-2872-4c76-9568-71e9caeca2b9', 'volume_size': 1}
Nov 05 09:39:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:39:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-595494073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc99933d-2872-4c76-9568-71e9caeca2b9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6c4df33d790c40d6bcefe4803f3910f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:39:29Z,use_quota=True,user_id='2cc47b3bf28d47c69326602b06aa3fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] Creating volume dc99933d-2872-4c76-9568-71e9caeca2b9 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:39:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:39:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:39:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:39:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:39:28 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:39:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dc99933d-2872-4c76-9568-71e9caeca2b9 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:39:29 devstack sudo[96703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dc99933d-2872-4c76-9568-71e9caeca2b9 1073741824
Nov 05 09:39:29 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:39:29 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root
Nov 05 09:39:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dc99933d-2872-4c76-9568-71e9caeca2b9 1073741824" returned: 0 in 0.536s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:39:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dc99933d-2872-4c76-9568-71e9caeca2b9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:39:29 devstack sudo[96722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dc99933d-2872-4c76-9568-71e9caeca2b9
Nov 05 09:39:29 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:39:29 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root
Nov 05 09:39:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dc99933d-2872-4c76-9568-71e9caeca2b9" returned: 0 in 0.286s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:39:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:39:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:39:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6609559e-247f-4dc3-94f3-81e3ac69eed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc99933d-2872-4c76-9568-71e9caeca2b9', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:39:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc856e4-a489-4c2f-9b10-fcbfc8b24946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:39:29 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] Volume volume-dc99933d-2872-4c76-9568-71e9caeca2b9 (dc99933d-2872-4c76-9568-71e9caeca2b9): created successfully
Nov 05 09:39:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc856e4-a489-4c2f-9b10-fcbfc8b24946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:39:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] Flow 'volume_create_manager' (591f62b4-8500-443c-95dd-19ae3570c856) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:39:29 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-b6907785-b813-4024-8467-d6b0ad739861 req-5f2efaea-a869-4819-bf9f-f074dc49dfd0 tempest-VolumesGetTestJSON-1365941427 None] Created volume successfully.
Nov 05 09:39:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-2934b8bd-f329-4cae-a71b-f8d28fde6c44 req-a4e272a9-fcff-4eea-a4cd-5b608dd30329 tempest-VolumesGetTestJSON-1365941427 None] Acquiring lock "cinder-dc99933d-2872-4c76-9568-71e9caeca2b9-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:39:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-2934b8bd-f329-4cae-a71b-f8d28fde6c44 req-a4e272a9-fcff-4eea-a4cd-5b608dd30329 tempest-VolumesGetTestJSON-1365941427 None] Lock "cinder-dc99933d-2872-4c76-9568-71e9caeca2b9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:39:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-2934b8bd-f329-4cae-a71b-f8d28fde6c44 req-a4e272a9-fcff-4eea-a4cd-5b608dd30329 tempest-VolumesGetTestJSON-1365941427 None] Acquiring lock "cinder-quobyte-dc99933d-2872-4c76-9568-71e9caeca2b9" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:39:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-2934b8bd-f329-4cae-a71b-f8d28fde6c44 req-a4e272a9-fcff-4eea-a4cd-5b608dd30329 tempest-VolumesGetTestJSON-1365941427 None] Lock "cinder-quobyte-dc99933d-2872-4c76-9568-71e9caeca2b9" acquired by "delete_volume" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:39:31 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbb7b4d-31b9-4791-b0c4-799fae90bc9b]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:39:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-2934b8bd-f329-4cae-a71b-f8d28fde6c44 req-a4e272a9-fcff-4eea-a4cd-5b608dd30329 tempest-VolumesGetTestJSON-1365941427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dc99933d-2872-4c76-9568-71e9caeca2b9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:39:31 devstack sudo[96728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dc99933d-2872-4c76-9568-71e9caeca2b9
Nov 05 09:39:31 devstack sudo[96728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:39:32 devstack sudo[96728]: pam_unix(sudo:session): session closed for user root
Nov 05 09:39:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-2934b8bd-f329-4cae-a71b-f8d28fde6c44 req-a4e272a9-fcff-4eea-a4cd-5b608dd30329 tempest-VolumesGetTestJSON-1365941427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dc99933d-2872-4c76-9568-71e9caeca2b9" returned: 0 in 0.700s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:39:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-2934b8bd-f329-4cae-a71b-f8d28fde6c44 req-a4e272a9-fcff-4eea-a4cd-5b608dd30329 tempest-VolumesGetTestJSON-1365941427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dc99933d-2872-4c76-9568-71e9caeca2b9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:39:32 devstack sudo[96787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dc99933d-2872-4c76-9568-71e9caeca2b9
Nov 05 09:39:32 devstack sudo[96787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:39:32 devstack sudo[96787]: pam_unix(sudo:session): session closed for user root
Nov 05 09:39:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-2934b8bd-f329-4cae-a71b-f8d28fde6c44 req-a4e272a9-fcff-4eea-a4cd-5b608dd30329 tempest-VolumesGetTestJSON-1365941427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dc99933d-2872-4c76-9568-71e9caeca2b9" returned: 0 in 0.381s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:39:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-2934b8bd-f329-4cae-a71b-f8d28fde6c44 req-a4e272a9-fcff-4eea-a4cd-5b608dd30329 tempest-VolumesGetTestJSON-1365941427 None] Lock "cinder-quobyte-dc99933d-2872-4c76-9568-71e9caeca2b9" released by "delete_volume" :: held 1.147s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:39:32 devstack cinder-volume[86649]: DEBUG cinder.quota [req-2934b8bd-f329-4cae-a71b-f8d28fde6c44 req-a4e272a9-fcff-4eea-a4cd-5b608dd30329 tempest-VolumesGetTestJSON-1365941427 None] Created reservations ['4452a3b2-ddc8-4dfb-ab0d-b691cc7c40dd', 'b993c9c1-006e-497b-a071-4159b15d71dc', '200d06ed-91a1-49fe-82c2-0944b1a1e2ee', 'fe206d5a-883e-4801-aff4-61aafe945f4c'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:39:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-2934b8bd-f329-4cae-a71b-f8d28fde6c44 req-a4e272a9-fcff-4eea-a4cd-5b608dd30329 tempest-VolumesGetTestJSON-1365941427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:39:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-2934b8bd-f329-4cae-a71b-f8d28fde6c44 req-a4e272a9-fcff-4eea-a4cd-5b608dd30329 tempest-VolumesGetTestJSON-1365941427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:39:32 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [req-2934b8bd-f329-4cae-a71b-f8d28fde6c44 req-a4e272a9-fcff-4eea-a4cd-5b608dd30329 tempest-VolumesGetTestJSON-1365941427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:39:32 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [req-2934b8bd-f329-4cae-a71b-f8d28fde6c44 req-a4e272a9-fcff-4eea-a4cd-5b608dd30329 tempest-VolumesGetTestJSON-1365941427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:39:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-2934b8bd-f329-4cae-a71b-f8d28fde6c44 req-a4e272a9-fcff-4eea-a4cd-5b608dd30329 tempest-VolumesGetTestJSON-1365941427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:39:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-2934b8bd-f329-4cae-a71b-f8d28fde6c44 req-a4e272a9-fcff-4eea-a4cd-5b608dd30329 tempest-VolumesGetTestJSON-1365941427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:39:32 devstack sudo[96802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:39:32 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:39:33 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root
Nov 05 09:39:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-2934b8bd-f329-4cae-a71b-f8d28fde6c44 req-a4e272a9-fcff-4eea-a4cd-5b608dd30329 tempest-VolumesGetTestJSON-1365941427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.294s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:39:33 devstack cinder-volume[86649]: DEBUG cinder.manager [req-2934b8bd-f329-4cae-a71b-f8d28fde6c44 req-a4e272a9-fcff-4eea-a4cd-5b608dd30329 tempest-VolumesGetTestJSON-1365941427 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:39:33 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-2934b8bd-f329-4cae-a71b-f8d28fde6c44 req-a4e272a9-fcff-4eea-a4cd-5b608dd30329 tempest-VolumesGetTestJSON-1365941427 None] Deleted volume successfully.
Nov 05 09:39:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-2934b8bd-f329-4cae-a71b-f8d28fde6c44 req-a4e272a9-fcff-4eea-a4cd-5b608dd30329 tempest-VolumesGetTestJSON-1365941427 None] Lock "cinder-dc99933d-2872-4c76-9568-71e9caeca2b9-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:39:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-16b4b19d-42b9-4ed2-8988-5e0798a06724 tempest-BackendsCapabilitiesAdminTestsJSON-1718709157 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.522720336914, 'free_capacity_gb': 1773.522720336914, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86649) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 05 09:39:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-beb48f72-bbbc-463a-9ab6-6fc57f6fa345 tempest-BackendsCapabilitiesAdminTestsJSON-1718709157 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.522720336914, 'free_capacity_gb': 1773.522720336914, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86649) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 05 09:39:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-e71e5cf2-4afc-455e-97cb-da364304b81f req-6da5557d-d34f-4355-a8b6-703814b74b30 tempest-TestInstancesWithCinderVolumes-333875698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:39:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-e71e5cf2-4afc-455e-97cb-da364304b81f req-6da5557d-d34f-4355-a8b6-703814b74b30 tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:39:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-e71e5cf2-4afc-455e-97cb-da364304b81f req-6da5557d-d34f-4355-a8b6-703814b74b30 tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:39:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-e71e5cf2-4afc-455e-97cb-da364304b81f req-6da5557d-d34f-4355-a8b6-703814b74b30 tempest-TestInstancesWithCinderVolumes-333875698 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1', 'name': 'volume-a58e882d-3907-4dfd-a5ff-e56505f592b1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bef1d83f-425e-4e51-b1f5-1b7c517b35ae', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 09:39:41 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-e71e5cf2-4afc-455e-97cb-da364304b81f req-6da5557d-d34f-4355-a8b6-703814b74b30 tempest-TestInstancesWithCinderVolumes-333875698 None] attachment_update completed successfully.
Nov 05 09:39:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-c40ecdd0-bd89-4ba2-a182-613ddb12e235 req-d7f5804e-cb66-4fbd-af8e-81884a42e5db tempest-TestInstancesWithCinderVolumes-333875698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:39:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-c40ecdd0-bd89-4ba2-a182-613ddb12e235 req-d7f5804e-cb66-4fbd-af8e-81884a42e5db tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:39:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-c40ecdd0-bd89-4ba2-a182-613ddb12e235 req-d7f5804e-cb66-4fbd-af8e-81884a42e5db tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:39:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-c40ecdd0-bd89-4ba2-a182-613ddb12e235 req-d7f5804e-cb66-4fbd-af8e-81884a42e5db tempest-TestInstancesWithCinderVolumes-333875698 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1', 'name': 'volume-9beccbd3-c352-4c11-9ecd-5da7c4a7077b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a4b0f051-5d19-47f5-a13d-974d4ba35db3', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 09:39:45 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-c40ecdd0-bd89-4ba2-a182-613ddb12e235 req-d7f5804e-cb66-4fbd-af8e-81884a42e5db tempest-TestInstancesWithCinderVolumes-333875698 None] attachment_update completed successfully.
Nov 05 09:39:50 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-e6a45cce-ebcd-4020-8c27-83de9213f838 req-dcfa9514-1f17-4b9a-a867-f2592c9c19bf tempest-TestInstancesWithCinderVolumes-333875698 None] Terminate volume connection completed successfully.
Nov 05 09:39:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-e6a45cce-ebcd-4020-8c27-83de9213f838 req-dcfa9514-1f17-4b9a-a867-f2592c9c19bf tempest-TestInstancesWithCinderVolumes-333875698 None] Deleting attachment bef1d83f-425e-4e51-b1f5-1b7c517b35ae. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 09:39:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2b8caf25-f099-4834-bcb1-abf692dad86d tempest-TestInstancesWithCinderVolumes-333875698 None] Acquiring lock "cinder-a58e882d-3907-4dfd-a5ff-e56505f592b1-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:39:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2b8caf25-f099-4834-bcb1-abf692dad86d tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "cinder-a58e882d-3907-4dfd-a5ff-e56505f592b1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:39:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2b8caf25-f099-4834-bcb1-abf692dad86d tempest-TestInstancesWithCinderVolumes-333875698 None] Acquiring lock "cinder-quobyte-a58e882d-3907-4dfd-a5ff-e56505f592b1" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:39:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2b8caf25-f099-4834-bcb1-abf692dad86d tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "cinder-quobyte-a58e882d-3907-4dfd-a5ff-e56505f592b1" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:39:51 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[f972e692-e4ef-4181-8c86-48cb4bb52ac8]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:39:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2b8caf25-f099-4834-bcb1-abf692dad86d tempest-TestInstancesWithCinderVolumes-333875698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a58e882d-3907-4dfd-a5ff-e56505f592b1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:39:51 devstack sudo[96954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a58e882d-3907-4dfd-a5ff-e56505f592b1
Nov 05 09:39:51 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:39:51 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root
Nov 05 09:39:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2b8caf25-f099-4834-bcb1-abf692dad86d tempest-TestInstancesWithCinderVolumes-333875698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a58e882d-3907-4dfd-a5ff-e56505f592b1" returned: 0 in 0.445s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:39:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2b8caf25-f099-4834-bcb1-abf692dad86d tempest-TestInstancesWithCinderVolumes-333875698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a58e882d-3907-4dfd-a5ff-e56505f592b1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:39:51 devstack sudo[96962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a58e882d-3907-4dfd-a5ff-e56505f592b1
Nov 05 09:39:51 devstack sudo[96962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:39:52 devstack sudo[96962]: pam_unix(sudo:session): session closed for user root
Nov 05 09:39:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2b8caf25-f099-4834-bcb1-abf692dad86d tempest-TestInstancesWithCinderVolumes-333875698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a58e882d-3907-4dfd-a5ff-e56505f592b1" returned: 0 in 0.294s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:39:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2b8caf25-f099-4834-bcb1-abf692dad86d tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "cinder-quobyte-a58e882d-3907-4dfd-a5ff-e56505f592b1" released by "delete_volume" :: held 0.793s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:39:52 devstack cinder-volume[86649]: WARNING cinder.quota [None req-2b8caf25-f099-4834-bcb1-abf692dad86d tempest-TestInstancesWithCinderVolumes-333875698 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1715113219-1353454802 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1715113219-1353454802, it is now deprecated. Please use the default quota class for default quota.
Nov 05 09:39:52 devstack cinder-volume[86649]: WARNING cinder.quota [None req-2b8caf25-f099-4834-bcb1-abf692dad86d tempest-TestInstancesWithCinderVolumes-333875698 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1715113219-1353454802 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1715113219-1353454802, it is now deprecated. Please use the default quota class for default quota.
Nov 05 09:39:52 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-2b8caf25-f099-4834-bcb1-abf692dad86d tempest-TestInstancesWithCinderVolumes-333875698 None] Created reservations ['8086961e-15d4-414e-bc04-4a4a60bc678a', '17d4af1d-a73a-4047-bb57-efc2baead2d2', 'f7e5edcd-6133-45de-a79c-5d0dc6524f2d', 'b88dc5dd-4c2e-479e-9a1e-5db1f949bdd8'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:39:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2b8caf25-f099-4834-bcb1-abf692dad86d tempest-TestInstancesWithCinderVolumes-333875698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:39:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2b8caf25-f099-4834-bcb1-abf692dad86d tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:39:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2b8caf25-f099-4834-bcb1-abf692dad86d tempest-TestInstancesWithCinderVolumes-333875698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:39:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2b8caf25-f099-4834-bcb1-abf692dad86d tempest-TestInstancesWithCinderVolumes-333875698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:39:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2b8caf25-f099-4834-bcb1-abf692dad86d tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:39:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2b8caf25-f099-4834-bcb1-abf692dad86d tempest-TestInstancesWithCinderVolumes-333875698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:39:52 devstack sudo[96965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:39:52 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:39:52 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root
Nov 05 09:39:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2b8caf25-f099-4834-bcb1-abf692dad86d tempest-TestInstancesWithCinderVolumes-333875698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.297s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:39:52 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-2b8caf25-f099-4834-bcb1-abf692dad86d tempest-TestInstancesWithCinderVolumes-333875698 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:39:52 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-2b8caf25-f099-4834-bcb1-abf692dad86d tempest-TestInstancesWithCinderVolumes-333875698 None] Deleted volume successfully.
Nov 05 09:39:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2b8caf25-f099-4834-bcb1-abf692dad86d tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "cinder-a58e882d-3907-4dfd-a5ff-e56505f592b1-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:39:55 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-38b87a66-9e2e-4690-a65d-7eb0507efa6b req-023266e2-6b17-4647-87e6-5b0377eed2e9 tempest-TestInstancesWithCinderVolumes-333875698 None] Terminate volume connection completed successfully.
Nov 05 09:39:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-38b87a66-9e2e-4690-a65d-7eb0507efa6b req-023266e2-6b17-4647-87e6-5b0377eed2e9 tempest-TestInstancesWithCinderVolumes-333875698 None] Deleting attachment a4b0f051-5d19-47f5-a13d-974d4ba35db3. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 09:39:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ae466ff7-4911-4128-a7d5-d5960e3ca45f tempest-TestInstancesWithCinderVolumes-333875698 None] Acquiring lock "cinder-9beccbd3-c352-4c11-9ecd-5da7c4a7077b-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:39:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ae466ff7-4911-4128-a7d5-d5960e3ca45f tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "cinder-9beccbd3-c352-4c11-9ecd-5da7c4a7077b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:39:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ae466ff7-4911-4128-a7d5-d5960e3ca45f tempest-TestInstancesWithCinderVolumes-333875698 None] Acquiring lock "cinder-quobyte-9beccbd3-c352-4c11-9ecd-5da7c4a7077b" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:39:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ae466ff7-4911-4128-a7d5-d5960e3ca45f tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "cinder-quobyte-9beccbd3-c352-4c11-9ecd-5da7c4a7077b" acquired by "delete_volume" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:39:56 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceccee9b-8926-47d4-a1d4-0d1297118c52]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:39:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ae466ff7-4911-4128-a7d5-d5960e3ca45f tempest-TestInstancesWithCinderVolumes-333875698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9beccbd3-c352-4c11-9ecd-5da7c4a7077b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:39:56 devstack sudo[96990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9beccbd3-c352-4c11-9ecd-5da7c4a7077b
Nov 05 09:39:56 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:39:56 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root
Nov 05 09:39:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ae466ff7-4911-4128-a7d5-d5960e3ca45f tempest-TestInstancesWithCinderVolumes-333875698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9beccbd3-c352-4c11-9ecd-5da7c4a7077b" returned: 0 in 0.459s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:39:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ae466ff7-4911-4128-a7d5-d5960e3ca45f tempest-TestInstancesWithCinderVolumes-333875698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9beccbd3-c352-4c11-9ecd-5da7c4a7077b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:39:56 devstack sudo[96997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9beccbd3-c352-4c11-9ecd-5da7c4a7077b
Nov 05 09:39:56 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:39:57 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root
Nov 05 09:39:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ae466ff7-4911-4128-a7d5-d5960e3ca45f tempest-TestInstancesWithCinderVolumes-333875698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9beccbd3-c352-4c11-9ecd-5da7c4a7077b" returned: 0 in 0.302s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:39:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ae466ff7-4911-4128-a7d5-d5960e3ca45f tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "cinder-quobyte-9beccbd3-c352-4c11-9ecd-5da7c4a7077b" released by "delete_volume" :: held 0.821s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:39:57 devstack cinder-volume[86649]: WARNING cinder.quota [None req-ae466ff7-4911-4128-a7d5-d5960e3ca45f tempest-TestInstancesWithCinderVolumes-333875698 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-502394041-608743351 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-502394041-608743351, it is now deprecated. Please use the default quota class for default quota.
Nov 05 09:39:57 devstack cinder-volume[86649]: WARNING cinder.quota [None req-ae466ff7-4911-4128-a7d5-d5960e3ca45f tempest-TestInstancesWithCinderVolumes-333875698 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-502394041-608743351 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-502394041-608743351, it is now deprecated. Please use the default quota class for default quota.
Nov 05 09:39:57 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-ae466ff7-4911-4128-a7d5-d5960e3ca45f tempest-TestInstancesWithCinderVolumes-333875698 None] Created reservations ['0a5cd921-1d23-4081-af70-a4b4cbe3758c', '9b4261aa-e215-4ef3-8049-d667bfbd7c84', '9f78a153-618c-48cd-b3b7-2e31e229dacd', '8c642765-cb9f-4d23-b4ff-97ff7f6fd5c5'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:39:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ae466ff7-4911-4128-a7d5-d5960e3ca45f tempest-TestInstancesWithCinderVolumes-333875698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:39:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ae466ff7-4911-4128-a7d5-d5960e3ca45f tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:39:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ae466ff7-4911-4128-a7d5-d5960e3ca45f tempest-TestInstancesWithCinderVolumes-333875698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:39:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ae466ff7-4911-4128-a7d5-d5960e3ca45f tempest-TestInstancesWithCinderVolumes-333875698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:39:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ae466ff7-4911-4128-a7d5-d5960e3ca45f tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:39:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ae466ff7-4911-4128-a7d5-d5960e3ca45f tempest-TestInstancesWithCinderVolumes-333875698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:39:57 devstack sudo[97000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:39:57 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:39:57 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root
Nov 05 09:39:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ae466ff7-4911-4128-a7d5-d5960e3ca45f tempest-TestInstancesWithCinderVolumes-333875698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.262s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:39:57 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-ae466ff7-4911-4128-a7d5-d5960e3ca45f tempest-TestInstancesWithCinderVolumes-333875698 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:39:57 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ae466ff7-4911-4128-a7d5-d5960e3ca45f tempest-TestInstancesWithCinderVolumes-333875698 None] Deleted volume successfully.
Nov 05 09:39:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ae466ff7-4911-4128-a7d5-d5960e3ca45f tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "cinder-9beccbd3-c352-4c11-9ecd-5da7c4a7077b-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:39:59 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:39:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Flow 'volume_create_manager' (e71b3adc-22d0-46b8-a599-f95812730316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:39:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e9224ef-3bac-401f-939d-4e0733efcdb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:39:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e9224ef-3bac-401f-939d-4e0733efcdb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1471850907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7320ce68-d1a9-4b82-8212-405917fc345f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0422da077d748f0ae3238da7b9e5ae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:40:00Z,use_quota=True,user_id='19a78eda4960427eab06d70c269940ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:39:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc7a180-d167-4d94-bef9-3aadcadedf25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:39:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc7a180-d167-4d94-bef9-3aadcadedf25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:39:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8baaa402-11f2-4f8a-9c6d-81d2520781c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:39:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8baaa402-11f2-4f8a-9c6d-81d2520781c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7320ce68-d1a9-4b82-8212-405917fc345f', 'volume_name': 'volume-7320ce68-d1a9-4b82-8212-405917fc345f', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:39:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0925ee21-20b8-46e3-b694-dcc143b954de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:39:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0925ee21-20b8-46e3-b694-dcc143b954de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:39:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef8cb0bf-fe22-408b-b6ab-46f441645758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:39:59 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Volume 7320ce68-d1a9-4b82-8212-405917fc345f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7320ce68-d1a9-4b82-8212-405917fc345f', 'volume_size': 1}
Nov 05 09:39:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:39:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:39:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1471850907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7320ce68-d1a9-4b82-8212-405917fc345f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0422da077d748f0ae3238da7b9e5ae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:40:00Z,use_quota=True,user_id='19a78eda4960427eab06d70c269940ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:39:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Creating volume 7320ce68-d1a9-4b82-8212-405917fc345f {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:39:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:39:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:39:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:39:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:39:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:39:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:39:59 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:39:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7320ce68-d1a9-4b82-8212-405917fc345f 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:39:59 devstack sudo[97005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7320ce68-d1a9-4b82-8212-405917fc345f 1073741824
Nov 05 09:39:59 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:40:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:40:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:40:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:40:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:40:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:40:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:40:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:40:00 devstack sudo[97013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:40:00 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:40:00 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root
Nov 05 09:40:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7320ce68-d1a9-4b82-8212-405917fc345f 1073741824" returned: 0 in 0.728s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:40:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7320ce68-d1a9-4b82-8212-405917fc345f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:40:00 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root
Nov 05 09:40:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.463s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:40:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:40:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:40:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 28 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:40:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>, <Thread(tpool_thread_0, started daemon 132223357408960)>, <Thread(tpool_thread_1, started daemon 132223349016256)>, <Thread(tpool_thread_2, started daemon 132223340623552)>, <Thread(tpool_thread_3, started daemon 132223332230848)>, <Thread(tpool_thread_4, started daemon 132223323838144)>, <Thread(tpool_thread_5, started daemon 132223315445440)>, <Thread(tpool_thread_6, started daemon 132223307052736)>, <Thread(tpool_thread_7, started daemon 132223298660032)>, <Thread(tpool_thread_8, started daemon 132223290250944)>, <Thread(tpool_thread_9, started daemon 132223281841856)>, <Thread(tpool_thread_10, started daemon 132223273432768)>, <Thread(tpool_thread_11, started daemon 132223265023680)>, <Thread(tpool_thread_12, started daemon 132223256614592)>, <Thread(tpool_thread_13, started daemon 132223248205504)>, <Thread(tpool_thread_14, started daemon 132223239796416)>, <Thread(tpool_thread_15, started daemon 132223231387328)>, <Thread(tpool_thread_16, started daemon 132223222978240)>, <Thread(tpool_thread_17, started daemon 132223214569152)>, <Thread(tpool_thread_18, started daemon 132223206160064)>, <Thread(tpool_thread_19, started daemon 132223197750976)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:40:00 devstack sudo[97018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7320ce68-d1a9-4b82-8212-405917fc345f
Nov 05 09:40:00 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:40:00 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root
Nov 05 09:40:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7320ce68-d1a9-4b82-8212-405917fc345f" returned: 0 in 0.364s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:40:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:40:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:40:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef8cb0bf-fe22-408b-b6ab-46f441645758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7320ce68-d1a9-4b82-8212-405917fc345f', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:40:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59b9c13-ece0-446d-9adb-30cbb6bcdc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:40:01 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Volume volume-7320ce68-d1a9-4b82-8212-405917fc345f (7320ce68-d1a9-4b82-8212-405917fc345f): created successfully
Nov 05 09:40:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59b9c13-ece0-446d-9adb-30cbb6bcdc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:40:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Flow 'volume_create_manager' (e71b3adc-22d0-46b8-a599-f95812730316) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:40:01 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-23166388-c99b-45ef-84aa-2c6643e0ed03 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Created volume successfully.
Nov 05 09:40:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-30ca0841-319e-4e42-a45b-5652f7bae12f req-dbe74ef6-75f6-4bb6-a17b-ca2ec45b62d8 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:40:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-30ca0841-319e-4e42-a45b-5652f7bae12f req-dbe74ef6-75f6-4bb6-a17b-ca2ec45b62d8 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:40:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-30ca0841-319e-4e42-a45b-5652f7bae12f req-dbe74ef6-75f6-4bb6-a17b-ca2ec45b62d8 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:40:02 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-84e2aa90-3e2d-4cd6-81e9-0981a0193847 req-c0e8e0c1-1e50-4cde-a42c-758b73db9c50 tempest-TestInstancesWithCinderVolumes-333875698 None] Terminate volume connection completed successfully.
Nov 05 09:40:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-84e2aa90-3e2d-4cd6-81e9-0981a0193847 req-c0e8e0c1-1e50-4cde-a42c-758b73db9c50 tempest-TestInstancesWithCinderVolumes-333875698 None] Deleting attachment 6bfdcb30-43e0-4023-9d6e-338acbbce4ee. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 09:40:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-30ca0841-319e-4e42-a45b-5652f7bae12f req-dbe74ef6-75f6-4bb6-a17b-ca2ec45b62d8 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1', 'name': 'volume-7320ce68-d1a9-4b82-8212-405917fc345f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8b673649-deee-4c61-9174-be1f2e3919d1', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 09:40:02 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-30ca0841-319e-4e42-a45b-5652f7bae12f req-dbe74ef6-75f6-4bb6-a17b-ca2ec45b62d8 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] attachment_update completed successfully.
Nov 05 09:40:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7fe7d4ae-4b67-409a-ab08-8619280a00d3 tempest-TestInstancesWithCinderVolumes-333875698 None] Acquiring lock "cinder-045d0cb1-653a-4f17-835a-8779c5639f43-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:40:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7fe7d4ae-4b67-409a-ab08-8619280a00d3 tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "cinder-045d0cb1-653a-4f17-835a-8779c5639f43-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:40:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7fe7d4ae-4b67-409a-ab08-8619280a00d3 tempest-TestInstancesWithCinderVolumes-333875698 None] Acquiring lock "cinder-quobyte-045d0cb1-653a-4f17-835a-8779c5639f43" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:40:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7fe7d4ae-4b67-409a-ab08-8619280a00d3 tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "cinder-quobyte-045d0cb1-653a-4f17-835a-8779c5639f43" acquired by "delete_volume" :: waited 0.028s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:40:05 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[7160dd9d-a94a-47f2-a49b-1f984d9c9a31]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:40:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7fe7d4ae-4b67-409a-ab08-8619280a00d3 tempest-TestInstancesWithCinderVolumes-333875698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-045d0cb1-653a-4f17-835a-8779c5639f43 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:40:05 devstack sudo[97484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-045d0cb1-653a-4f17-835a-8779c5639f43
Nov 05 09:40:05 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:40:05 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root
Nov 05 09:40:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7fe7d4ae-4b67-409a-ab08-8619280a00d3 tempest-TestInstancesWithCinderVolumes-333875698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-045d0cb1-653a-4f17-835a-8779c5639f43" returned: 0 in 0.458s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:40:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7fe7d4ae-4b67-409a-ab08-8619280a00d3 tempest-TestInstancesWithCinderVolumes-333875698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-045d0cb1-653a-4f17-835a-8779c5639f43 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:40:05 devstack sudo[97489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-045d0cb1-653a-4f17-835a-8779c5639f43
Nov 05 09:40:05 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:40:05 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root
Nov 05 09:40:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7fe7d4ae-4b67-409a-ab08-8619280a00d3 tempest-TestInstancesWithCinderVolumes-333875698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-045d0cb1-653a-4f17-835a-8779c5639f43" returned: 0 in 0.333s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:40:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7fe7d4ae-4b67-409a-ab08-8619280a00d3 tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "cinder-quobyte-045d0cb1-653a-4f17-835a-8779c5639f43" released by "delete_volume" :: held 0.861s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:40:05 devstack cinder-volume[86649]: WARNING cinder.quota [None req-7fe7d4ae-4b67-409a-ab08-8619280a00d3 tempest-TestInstancesWithCinderVolumes-333875698 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-20101591-181784903 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-20101591-181784903, it is now deprecated. Please use the default quota class for default quota.
Nov 05 09:40:05 devstack cinder-volume[86649]: WARNING cinder.quota [None req-7fe7d4ae-4b67-409a-ab08-8619280a00d3 tempest-TestInstancesWithCinderVolumes-333875698 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-20101591-181784903 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-20101591-181784903, it is now deprecated. Please use the default quota class for default quota.
Nov 05 09:40:06 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-7fe7d4ae-4b67-409a-ab08-8619280a00d3 tempest-TestInstancesWithCinderVolumes-333875698 None] Created reservations ['7b2fe91e-cd50-48d8-b78d-2ec0d198f406', '11f0984e-40b6-47c1-ac45-daab9a5a0537', '1d78a4cb-fc75-42a9-af9e-ff6f68666cac', '63cdee4e-6a7c-4858-834b-03e27dbea19e'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:40:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7fe7d4ae-4b67-409a-ab08-8619280a00d3 tempest-TestInstancesWithCinderVolumes-333875698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:40:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7fe7d4ae-4b67-409a-ab08-8619280a00d3 tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:40:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7fe7d4ae-4b67-409a-ab08-8619280a00d3 tempest-TestInstancesWithCinderVolumes-333875698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:40:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7fe7d4ae-4b67-409a-ab08-8619280a00d3 tempest-TestInstancesWithCinderVolumes-333875698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:40:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7fe7d4ae-4b67-409a-ab08-8619280a00d3 tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:40:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7fe7d4ae-4b67-409a-ab08-8619280a00d3 tempest-TestInstancesWithCinderVolumes-333875698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:40:06 devstack sudo[97492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:40:06 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:40:06 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root
Nov 05 09:40:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7fe7d4ae-4b67-409a-ab08-8619280a00d3 tempest-TestInstancesWithCinderVolumes-333875698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.306s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:40:06 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-7fe7d4ae-4b67-409a-ab08-8619280a00d3 tempest-TestInstancesWithCinderVolumes-333875698 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:40:06 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-7fe7d4ae-4b67-409a-ab08-8619280a00d3 tempest-TestInstancesWithCinderVolumes-333875698 None] Deleted volume successfully.
Nov 05 09:40:06 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=54,cinder:SELECT=60,cinder:INSERT=15,cinder:DELETE=5 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:40:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7fe7d4ae-4b67-409a-ab08-8619280a00d3 tempest-TestInstancesWithCinderVolumes-333875698 None] Lock "cinder-045d0cb1-653a-4f17-835a-8779c5639f43-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:40:06 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=66,cinder:UPDATE=67,cinder:INSERT=13,cinder:DELETE=4 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:40:06 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-b198c5a7-6d2e-4303-8a6d-4cb8e523e17d req-6005eed7-c58b-4198-8627-67e9ed142d2a tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Terminate volume connection completed successfully.
Nov 05 09:40:06 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-b198c5a7-6d2e-4303-8a6d-4cb8e523e17d req-6005eed7-c58b-4198-8627-67e9ed142d2a tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Deleting attachment 8b673649-deee-4c61-9174-be1f2e3919d1. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 09:40:07 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bee69b89-d35b-4742-b192-6e078a99a416 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Acquiring lock "cinder-7320ce68-d1a9-4b82-8212-405917fc345f-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:40:07 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bee69b89-d35b-4742-b192-6e078a99a416 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Lock "cinder-7320ce68-d1a9-4b82-8212-405917fc345f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:40:07 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bee69b89-d35b-4742-b192-6e078a99a416 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Acquiring lock "cinder-quobyte-7320ce68-d1a9-4b82-8212-405917fc345f" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:40:07 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bee69b89-d35b-4742-b192-6e078a99a416 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Lock "cinder-quobyte-7320ce68-d1a9-4b82-8212-405917fc345f" acquired by "delete_volume" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:40:07 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48e6ea9-21a4-409a-95af-d7ec35a966a6]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:40:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bee69b89-d35b-4742-b192-6e078a99a416 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7320ce68-d1a9-4b82-8212-405917fc345f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:40:07 devstack sudo[97522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7320ce68-d1a9-4b82-8212-405917fc345f
Nov 05 09:40:07 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:40:08 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root
Nov 05 09:40:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bee69b89-d35b-4742-b192-6e078a99a416 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7320ce68-d1a9-4b82-8212-405917fc345f" returned: 0 in 0.464s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:40:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bee69b89-d35b-4742-b192-6e078a99a416 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7320ce68-d1a9-4b82-8212-405917fc345f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:40:08 devstack sudo[97528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7320ce68-d1a9-4b82-8212-405917fc345f
Nov 05 09:40:08 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:40:08 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root
Nov 05 09:40:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bee69b89-d35b-4742-b192-6e078a99a416 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7320ce68-d1a9-4b82-8212-405917fc345f" returned: 0 in 0.280s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:40:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bee69b89-d35b-4742-b192-6e078a99a416 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Lock "cinder-quobyte-7320ce68-d1a9-4b82-8212-405917fc345f" released by "delete_volume" :: held 0.796s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:40:08 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-bee69b89-d35b-4742-b192-6e078a99a416 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Created reservations ['f1838556-b16f-4a38-8b1e-ce6317a2dbd6', 'ac7cb0a4-4489-4ea3-9b2f-6216811a37cf', 'aeb855fb-18da-4fb8-9ee6-52840cae620b', '3c97d82e-24ec-44b9-85aa-8af12016017c'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:40:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bee69b89-d35b-4742-b192-6e078a99a416 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:40:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bee69b89-d35b-4742-b192-6e078a99a416 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:40:08 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-bee69b89-d35b-4742-b192-6e078a99a416 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:40:08 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-bee69b89-d35b-4742-b192-6e078a99a416 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:40:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bee69b89-d35b-4742-b192-6e078a99a416 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:40:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bee69b89-d35b-4742-b192-6e078a99a416 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:40:08 devstack sudo[97531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:40:08 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:40:09 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root
Nov 05 09:40:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bee69b89-d35b-4742-b192-6e078a99a416 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.379s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:40:09 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-bee69b89-d35b-4742-b192-6e078a99a416 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:40:09 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-bee69b89-d35b-4742-b192-6e078a99a416 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Deleted volume successfully.
Nov 05 09:40:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bee69b89-d35b-4742-b192-6e078a99a416 tempest-TestServerVolumeAttachScenarioOldVersion-1807422666 None] Lock "cinder-7320ce68-d1a9-4b82-8212-405917fc345f-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:40:18 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=7,cinder:UPDATE=9,cinder:INSERT=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:40:19 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=4,cinder:INSERT=3,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:40:19 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:40:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Flow 'volume_create_manager' (81969bc3-2e7d-4bb5-aa34-bba75684e857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:40:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee918d7-5e4c-40c4-a742-10e1cbcd9011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:40:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee918d7-5e4c-40c4-a742-10e1cbcd9011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1028466334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5021c1a-c1f0-4412-8130-ff60f659913e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe5435bf41a04c7486e22e15113dde02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:40:20Z,use_quota=True,user_id='2d3fdecdcce14447a63a6474b03fed12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:40:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c4365c-959f-4ca4-a51a-624946dc00e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:40:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c4365c-959f-4ca4-a51a-624946dc00e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:40:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09bffd7d-078e-44ac-b2da-20e70f5c417b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:40:20 devstack cinder-volume[86649]: DEBUG cinder.image.glance [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Creating Keystone auth plugin from conf {{(pid=86649) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 09:40:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09bffd7d-078e-44ac-b2da-20e70f5c417b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c5021c1a-c1f0-4412-8130-ff60f659913e', 'volume_name': 'volume-c5021c1a-c1f0-4412-8130-ff60f659913e', 'volume_size': 1, 'image_id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ccc0fd9-02f4-4820-84b7-775604485a72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '407fc75c86be40efb1fcfded98df545b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'created_at': datetime.datetime(2026, 11, 5, 8, 20, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 8, 20, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ccc0fd9-02f4-4820-84b7-775604485a72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7841a6d0a660>}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:40:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4914d7f-136d-4f7f-8626-ce0b15fae0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:40:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4914d7f-136d-4f7f-8626-ce0b15fae0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:40:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12d65b18-d7e6-438e-8600-066af48105bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:40:20 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Volume c5021c1a-c1f0-4412-8130-ff60f659913e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c5021c1a-c1f0-4412-8130-ff60f659913e', 'volume_size': 1, 'image_id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ccc0fd9-02f4-4820-84b7-775604485a72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '407fc75c86be40efb1fcfded98df545b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'created_at': datetime.datetime(2026, 11, 5, 8, 20, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 8, 20, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ccc0fd9-02f4-4820-84b7-775604485a72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7841a6d0a660>}
Nov 05 09:40:20 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Trying to clone c5021c1a-c1f0-4412-8130-ff60f659913e from image 7ccc0fd9-02f4-4820-84b7-775604485a72 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7ccc0fd9-02f4-4820-84b7-775604485a72', 'metadata': {}}]). {{(pid=86649) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 09:40:20 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_xpaknct7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 09:40:20 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 09:40:20 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c093c5-d793-47a8-af61-5976855cf973]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:40:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_xpaknct7devstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:40:20 devstack sudo[97561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_xpaknct7devstack@QuobyteHD
Nov 05 09:40:20 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:40:21 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root
Nov 05 09:40:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_xpaknct7devstack@QuobyteHD" returned: 0 in 0.399s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:40:21 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Temporary image 7ccc0fd9-02f4-4820-84b7-775604485a72 is fetched for user 2d3fdecdcce14447a63a6474b03fed12. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 09:40:21 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5fbe01-411e-4395-9f6a-9cc306b6686d]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:40:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_xpaknct7devstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:40:21 devstack sudo[97566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_xpaknct7devstack@QuobyteHD
Nov 05 09:40:21 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:40:21 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root
Nov 05 09:40:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_xpaknct7devstack@QuobyteHD" returned: 0 in 0.365s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:40:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:40:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:40:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1028466334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5021c1a-c1f0-4412-8130-ff60f659913e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe5435bf41a04c7486e22e15113dde02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:40:20Z,use_quota=True,user_id='2d3fdecdcce14447a63a6474b03fed12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:40:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Creating volume c5021c1a-c1f0-4412-8130-ff60f659913e {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:40:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:40:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:40:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:40:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:40:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:40:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:40:21 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:40:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c5021c1a-c1f0-4412-8130-ff60f659913e 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:40:21 devstack sudo[97572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c5021c1a-c1f0-4412-8130-ff60f659913e 1073741824
Nov 05 09:40:21 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:40:22 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root
Nov 05 09:40:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c5021c1a-c1f0-4412-8130-ff60f659913e 1073741824" returned: 0 in 0.575s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:40:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c5021c1a-c1f0-4412-8130-ff60f659913e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:40:22 devstack sudo[97578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c5021c1a-c1f0-4412-8130-ff60f659913e
Nov 05 09:40:22 devstack sudo[97578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:40:22 devstack sudo[97578]: pam_unix(sudo:session): session closed for user root
Nov 05 09:40:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c5021c1a-c1f0-4412-8130-ff60f659913e" returned: 0 in 0.264s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:40:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:40:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:40:22 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Attempting download of 7ccc0fd9-02f4-4820-84b7-775604485a72 ((None, [{'url': 'file:///opt/stack/data/glance/images/7ccc0fd9-02f4-4820-84b7-775604485a72', 'metadata': {}}])) to volume c5021c1a-c1f0-4412-8130-ff60f659913e. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 09:40:22 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3a90a2-4782-4861-9b44-a497af48e661]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:40:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_wcd92nk5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:40:22 devstack sudo[97581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_wcd92nk5
Nov 05 09:40:22 devstack sudo[97581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:40:22 devstack sudo[97581]: pam_unix(sudo:session): session closed for user root
Nov 05 09:40:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_wcd92nk5" returned: 0 in 0.355s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:40:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_wcd92nk5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:40:22 devstack sudo[97586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_wcd92nk5
Nov 05 09:40:22 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:40:23 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root
Nov 05 09:40:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_wcd92nk5" returned: 1 in 0.360s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:40:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_wcd92nk5' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 09:40:23 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41932b7-61d2-4f7d-b562-b9a48377e156]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:40:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_xpaknct7devstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:40:23 devstack sudo[97590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_xpaknct7devstack@QuobyteHD
Nov 05 09:40:23 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:40:23 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root
Nov 05 09:40:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_xpaknct7devstack@QuobyteHD" returned: 0 in 0.344s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:40:23 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] 7ccc0fd9-02f4-4820-84b7-775604485a72 was qcow2, converting to qcow2 {{(pid=86649) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 09:40:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_xpaknct7devstack@QuobyteHD /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c5021c1a-c1f0-4412-8130-ff60f659913e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:40:23 devstack sudo[97595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_xpaknct7devstack@QuobyteHD /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c5021c1a-c1f0-4412-8130-ff60f659913e
Nov 05 09:40:23 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:40:25 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root
Nov 05 09:40:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_xpaknct7devstack@QuobyteHD /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c5021c1a-c1f0-4412-8130-ff60f659913e" returned: 0 in 2.107s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:40:25 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_xpaknct7devstack@QuobyteHD, size 112.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c5021c1a-c1f0-4412-8130-ff60f659913e {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 09:40:25 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Converted 112.00 MB image at 53.13 MB/s
Nov 05 09:40:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c5021c1a-c1f0-4412-8130-ff60f659913e 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:40:25 devstack sudo[97604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c5021c1a-c1f0-4412-8130-ff60f659913e 1G
Nov 05 09:40:25 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:40:26 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root
Nov 05 09:40:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c5021c1a-c1f0-4412-8130-ff60f659913e 1G" returned: 0 in 0.366s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:40:26 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Downloaded image 7ccc0fd9-02f4-4820-84b7-775604485a72 ((None, [{'url': 'file:///opt/stack/data/glance/images/7ccc0fd9-02f4-4820-84b7-775604485a72', 'metadata': {}}])) to volume c5021c1a-c1f0-4412-8130-ff60f659913e successfully. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 09:40:26 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Temporary image 7ccc0fd9-02f4-4820-84b7-775604485a72 for user 2d3fdecdcce14447a63a6474b03fed12 is deleted. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 09:40:26 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Marking volume c5021c1a-c1f0-4412-8130-ff60f659913e as bootable. {{(pid=86649) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 09:40:26 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Copying metadata from image 7ccc0fd9-02f4-4820-84b7-775604485a72 to c5021c1a-c1f0-4412-8130-ff60f659913e. {{(pid=86649) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 09:40:26 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Creating volume glance metadata for volume c5021c1a-c1f0-4412-8130-ff60f659913e backed by image 7ccc0fd9-02f4-4820-84b7-775604485a72 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86649) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 09:40:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12d65b18-d7e6-438e-8600-066af48105bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5021c1a-c1f0-4412-8130-ff60f659913e', 'volume_size': 1, 'image_id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ccc0fd9-02f4-4820-84b7-775604485a72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '407fc75c86be40efb1fcfded98df545b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'created_at': datetime.datetime(2026, 11, 5, 8, 20, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 8, 20, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ccc0fd9-02f4-4820-84b7-775604485a72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7841a6d0a660>}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:40:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84d1deee-9f88-449b-9bc9-f33bd0709130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:40:26 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Volume volume-c5021c1a-c1f0-4412-8130-ff60f659913e (c5021c1a-c1f0-4412-8130-ff60f659913e): created successfully
Nov 05 09:40:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84d1deee-9f88-449b-9bc9-f33bd0709130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:40:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Flow 'volume_create_manager' (81969bc3-2e7d-4bb5-aa34-bba75684e857) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:40:26 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ff441119-3282-47f0-9ccf-ef6299db4c88 tempest-VolumesImageMetadata-25044908 None] Created volume successfully.
Nov 05 09:40:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-636b123a-4b83-4a08-bdfd-b9a5ef181e60 tempest-VolumesImageMetadata-25044908 None] Acquiring lock "cinder-c5021c1a-c1f0-4412-8130-ff60f659913e-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:40:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-636b123a-4b83-4a08-bdfd-b9a5ef181e60 tempest-VolumesImageMetadata-25044908 None] Lock "cinder-c5021c1a-c1f0-4412-8130-ff60f659913e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:40:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-636b123a-4b83-4a08-bdfd-b9a5ef181e60 tempest-VolumesImageMetadata-25044908 None] Acquiring lock "cinder-quobyte-c5021c1a-c1f0-4412-8130-ff60f659913e" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:40:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-636b123a-4b83-4a08-bdfd-b9a5ef181e60 tempest-VolumesImageMetadata-25044908 None] Lock "cinder-quobyte-c5021c1a-c1f0-4412-8130-ff60f659913e" acquired by "delete_volume" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:40:27 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6aba571-6e2a-4fdf-8fb7-1b56bce72a13]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:40:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-636b123a-4b83-4a08-bdfd-b9a5ef181e60 tempest-VolumesImageMetadata-25044908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c5021c1a-c1f0-4412-8130-ff60f659913e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:40:27 devstack sudo[97611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c5021c1a-c1f0-4412-8130-ff60f659913e
Nov 05 09:40:27 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:40:27 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root
Nov 05 09:40:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-636b123a-4b83-4a08-bdfd-b9a5ef181e60 tempest-VolumesImageMetadata-25044908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c5021c1a-c1f0-4412-8130-ff60f659913e" returned: 0 in 0.370s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:40:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-636b123a-4b83-4a08-bdfd-b9a5ef181e60 tempest-VolumesImageMetadata-25044908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c5021c1a-c1f0-4412-8130-ff60f659913e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:40:27 devstack sudo[97616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c5021c1a-c1f0-4412-8130-ff60f659913e
Nov 05 09:40:27 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:40:27 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root
Nov 05 09:40:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-636b123a-4b83-4a08-bdfd-b9a5ef181e60 tempest-VolumesImageMetadata-25044908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c5021c1a-c1f0-4412-8130-ff60f659913e" returned: 0 in 0.279s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:40:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-636b123a-4b83-4a08-bdfd-b9a5ef181e60 tempest-VolumesImageMetadata-25044908 None] Lock "cinder-quobyte-c5021c1a-c1f0-4412-8130-ff60f659913e" released by "delete_volume" :: held 0.695s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:40:27 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-636b123a-4b83-4a08-bdfd-b9a5ef181e60 tempest-VolumesImageMetadata-25044908 None] Created reservations ['0dc877e1-4729-43f0-aef3-e14e73368041', 'ee8281c8-da7c-4d67-b0ef-1e7565071279', 'f6bb6aea-ea80-4213-9d9e-efbb29a0c54f', 'c8cf6089-e185-41e6-a222-87e3ccfdb894'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:40:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-636b123a-4b83-4a08-bdfd-b9a5ef181e60 tempest-VolumesImageMetadata-25044908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:40:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-636b123a-4b83-4a08-bdfd-b9a5ef181e60 tempest-VolumesImageMetadata-25044908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:40:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-636b123a-4b83-4a08-bdfd-b9a5ef181e60 tempest-VolumesImageMetadata-25044908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:40:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-636b123a-4b83-4a08-bdfd-b9a5ef181e60 tempest-VolumesImageMetadata-25044908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:40:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-636b123a-4b83-4a08-bdfd-b9a5ef181e60 tempest-VolumesImageMetadata-25044908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:40:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-636b123a-4b83-4a08-bdfd-b9a5ef181e60 tempest-VolumesImageMetadata-25044908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:40:27 devstack sudo[97622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:40:27 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:40:28 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root
Nov 05 09:40:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-636b123a-4b83-4a08-bdfd-b9a5ef181e60 tempest-VolumesImageMetadata-25044908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.271s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:40:28 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-636b123a-4b83-4a08-bdfd-b9a5ef181e60 tempest-VolumesImageMetadata-25044908 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:40:28 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-636b123a-4b83-4a08-bdfd-b9a5ef181e60 tempest-VolumesImageMetadata-25044908 None] Deleted volume successfully.
Nov 05 09:40:28 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-636b123a-4b83-4a08-bdfd-b9a5ef181e60 tempest-VolumesImageMetadata-25044908 None] Lock "cinder-c5021c1a-c1f0-4412-8130-ff60f659913e-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:40:36 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:40:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] Flow 'volume_create_manager' (59f419d3-52ec-4515-a6f5-ba0b3c007971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:40:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0218097-1c25-4c7b-84cd-f03767ae9a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:40:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0218097-1c25-4c7b-84cd-f03767ae9a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1903010888',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca707106-42d6-4685-b21a-71ff2adb2c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8239701c35364a9c8e0d8600a98ea7cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:40:37Z,use_quota=True,user_id='9f663d669b4f493db597aef436d92d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:40:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (648a8b13-7609-48f3-80fc-92eefa44fb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:40:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (648a8b13-7609-48f3-80fc-92eefa44fb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:40:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b14a71b4-2c86-468e-aee4-629388c47b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:40:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b14a71b4-2c86-468e-aee4-629388c47b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca707106-42d6-4685-b21a-71ff2adb2c79', 'volume_name': 'volume-ca707106-42d6-4685-b21a-71ff2adb2c79', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:40:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22f9209b-e2a8-4ab8-8744-59f0dd7c8673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:40:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22f9209b-e2a8-4ab8-8744-59f0dd7c8673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:40:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81388ede-816c-4482-ba2c-aebfbac66fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:40:37 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] Volume ca707106-42d6-4685-b21a-71ff2adb2c79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca707106-42d6-4685-b21a-71ff2adb2c79', 'volume_size': 1}
Nov 05 09:40:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:40:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:40:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1903010888',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca707106-42d6-4685-b21a-71ff2adb2c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8239701c35364a9c8e0d8600a98ea7cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:40:37Z,use_quota=True,user_id='9f663d669b4f493db597aef436d92d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:40:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] Creating volume ca707106-42d6-4685-b21a-71ff2adb2c79 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:40:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:40:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:40:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:40:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:40:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:40:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:40:37 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:40:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ca707106-42d6-4685-b21a-71ff2adb2c79 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:40:37 devstack sudo[97628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ca707106-42d6-4685-b21a-71ff2adb2c79 1073741824
Nov 05 09:40:37 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:40:37 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root
Nov 05 09:40:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ca707106-42d6-4685-b21a-71ff2adb2c79 1073741824" returned: 0 in 0.436s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:40:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ca707106-42d6-4685-b21a-71ff2adb2c79 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:40:37 devstack sudo[97667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ca707106-42d6-4685-b21a-71ff2adb2c79
Nov 05 09:40:37 devstack sudo[97667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:40:37 devstack sudo[97667]: pam_unix(sudo:session): session closed for user root
Nov 05 09:40:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ca707106-42d6-4685-b21a-71ff2adb2c79" returned: 0 in 0.288s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:40:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:40:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:40:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81388ede-816c-4482-ba2c-aebfbac66fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca707106-42d6-4685-b21a-71ff2adb2c79', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:40:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1565287f-8070-499d-b25b-40718a313bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:40:37 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] Volume volume-ca707106-42d6-4685-b21a-71ff2adb2c79 (ca707106-42d6-4685-b21a-71ff2adb2c79): created successfully
Nov 05 09:40:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1565287f-8070-499d-b25b-40718a313bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:40:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] Flow 'volume_create_manager' (59f419d3-52ec-4515-a6f5-ba0b3c007971) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:40:37 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-7dc90156-9167-4029-b985-2eecf16b0f49 tempest-VolumesTransfersTest-1143387533 None] Created volume successfully.
Nov 05 09:40:38 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-0d8633ab-acb8-4621-9dd1-e6f9758d0152 tempest-VolumesTransfersTest-1435092595 None] Transfer volume completed successfully.
Nov 05 09:40:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3d92d360-fe4f-4173-b65d-cdc61df2a3ff tempest-VolumesTransfersTest-919722067 None] Acquiring lock "cinder-ca707106-42d6-4685-b21a-71ff2adb2c79-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:40:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3d92d360-fe4f-4173-b65d-cdc61df2a3ff tempest-VolumesTransfersTest-919722067 None] Lock "cinder-ca707106-42d6-4685-b21a-71ff2adb2c79-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:40:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3d92d360-fe4f-4173-b65d-cdc61df2a3ff tempest-VolumesTransfersTest-919722067 None] Acquiring lock "cinder-quobyte-ca707106-42d6-4685-b21a-71ff2adb2c79" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:40:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3d92d360-fe4f-4173-b65d-cdc61df2a3ff tempest-VolumesTransfersTest-919722067 None] Lock "cinder-quobyte-ca707106-42d6-4685-b21a-71ff2adb2c79" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:40:39 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d938f1f1-7216-4b9c-b70b-95948154e98a]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:40:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3d92d360-fe4f-4173-b65d-cdc61df2a3ff tempest-VolumesTransfersTest-919722067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ca707106-42d6-4685-b21a-71ff2adb2c79 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:40:39 devstack sudo[97673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ca707106-42d6-4685-b21a-71ff2adb2c79
Nov 05 09:40:39 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:40:39 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root
Nov 05 09:40:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3d92d360-fe4f-4173-b65d-cdc61df2a3ff tempest-VolumesTransfersTest-919722067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ca707106-42d6-4685-b21a-71ff2adb2c79" returned: 0 in 0.384s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:40:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3d92d360-fe4f-4173-b65d-cdc61df2a3ff tempest-VolumesTransfersTest-919722067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ca707106-42d6-4685-b21a-71ff2adb2c79 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:40:39 devstack sudo[97678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ca707106-42d6-4685-b21a-71ff2adb2c79
Nov 05 09:40:39 devstack sudo[97678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:40:40 devstack sudo[97678]: pam_unix(sudo:session): session closed for user root
Nov 05 09:40:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3d92d360-fe4f-4173-b65d-cdc61df2a3ff tempest-VolumesTransfersTest-919722067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ca707106-42d6-4685-b21a-71ff2adb2c79" returned: 0 in 0.294s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:40:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3d92d360-fe4f-4173-b65d-cdc61df2a3ff tempest-VolumesTransfersTest-919722067 None] Lock "cinder-quobyte-ca707106-42d6-4685-b21a-71ff2adb2c79" released by "delete_volume" :: held 0.725s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:40:40 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-3d92d360-fe4f-4173-b65d-cdc61df2a3ff tempest-VolumesTransfersTest-919722067 None] Created reservations ['edee883e-f372-4fe4-b84d-02cf1d5fee48', '680a1d75-062d-41ad-bb1a-3af03b2a212b', 'e4fd639d-3839-4bf5-803e-8ff3169358c3', '4602faa0-7fbe-478b-8c26-562720c3843f'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:40:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3d92d360-fe4f-4173-b65d-cdc61df2a3ff tempest-VolumesTransfersTest-919722067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:40:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3d92d360-fe4f-4173-b65d-cdc61df2a3ff tempest-VolumesTransfersTest-919722067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:40:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3d92d360-fe4f-4173-b65d-cdc61df2a3ff tempest-VolumesTransfersTest-919722067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:40:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3d92d360-fe4f-4173-b65d-cdc61df2a3ff tempest-VolumesTransfersTest-919722067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:40:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3d92d360-fe4f-4173-b65d-cdc61df2a3ff tempest-VolumesTransfersTest-919722067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:40:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3d92d360-fe4f-4173-b65d-cdc61df2a3ff tempest-VolumesTransfersTest-919722067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:40:40 devstack sudo[97681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:40:40 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:40:40 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root
Nov 05 09:40:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3d92d360-fe4f-4173-b65d-cdc61df2a3ff tempest-VolumesTransfersTest-919722067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.328s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:40:40 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-3d92d360-fe4f-4173-b65d-cdc61df2a3ff tempest-VolumesTransfersTest-919722067 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:40:40 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-3d92d360-fe4f-4173-b65d-cdc61df2a3ff tempest-VolumesTransfersTest-919722067 None] Deleted volume successfully.
Nov 05 09:40:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3d92d360-fe4f-4173-b65d-cdc61df2a3ff tempest-VolumesTransfersTest-919722067 None] Lock "cinder-ca707106-42d6-4685-b21a-71ff2adb2c79-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:40:41 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:40:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] Flow 'volume_create_manager' (4db34d57-e243-434f-a788-041b6466b531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:40:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8070113-7f8b-4bfb-9fb7-a14f2d238c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:40:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8070113-7f8b-4bfb-9fb7-a14f2d238c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1595389138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=795c9bf9-261e-47a1-ae99-dc4e009cb139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8239701c35364a9c8e0d8600a98ea7cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:40:41Z,use_quota=True,user_id='9f663d669b4f493db597aef436d92d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:40:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e53d8e-d17e-47ae-bd61-c5daa0bc1666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:40:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e53d8e-d17e-47ae-bd61-c5daa0bc1666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:40:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8278826-4b91-4372-b5ff-f0c1b5d77374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:40:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8278826-4b91-4372-b5ff-f0c1b5d77374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '795c9bf9-261e-47a1-ae99-dc4e009cb139', 'volume_name': 'volume-795c9bf9-261e-47a1-ae99-dc4e009cb139', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:40:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (958c6721-f8c1-4b6c-998f-28fce9a4fe8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:40:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (958c6721-f8c1-4b6c-998f-28fce9a4fe8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:40:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ba0da4-7b35-4876-8fa7-38356b8f3940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:40:41 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] Volume 795c9bf9-261e-47a1-ae99-dc4e009cb139: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-795c9bf9-261e-47a1-ae99-dc4e009cb139', 'volume_size': 1}
Nov 05 09:40:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:40:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:40:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1595389138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=795c9bf9-261e-47a1-ae99-dc4e009cb139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8239701c35364a9c8e0d8600a98ea7cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:40:41Z,use_quota=True,user_id='9f663d669b4f493db597aef436d92d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:40:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] Creating volume 795c9bf9-261e-47a1-ae99-dc4e009cb139 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:40:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:40:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:40:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:40:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:40:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:40:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:40:41 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:40:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-795c9bf9-261e-47a1-ae99-dc4e009cb139 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:40:41 devstack sudo[97690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-795c9bf9-261e-47a1-ae99-dc4e009cb139 1073741824
Nov 05 09:40:41 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:40:41 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root
Nov 05 09:40:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-795c9bf9-261e-47a1-ae99-dc4e009cb139 1073741824" returned: 0 in 0.532s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:40:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-795c9bf9-261e-47a1-ae99-dc4e009cb139 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:40:42 devstack sudo[97696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-795c9bf9-261e-47a1-ae99-dc4e009cb139
Nov 05 09:40:42 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:40:42 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root
Nov 05 09:40:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-795c9bf9-261e-47a1-ae99-dc4e009cb139" returned: 0 in 0.294s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:40:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:40:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:40:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ba0da4-7b35-4876-8fa7-38356b8f3940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-795c9bf9-261e-47a1-ae99-dc4e009cb139', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:40:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d09b6874-0fd0-48a6-bb88-d77dca3a5ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:40:42 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] Volume volume-795c9bf9-261e-47a1-ae99-dc4e009cb139 (795c9bf9-261e-47a1-ae99-dc4e009cb139): created successfully
Nov 05 09:40:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d09b6874-0fd0-48a6-bb88-d77dca3a5ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:40:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] Flow 'volume_create_manager' (4db34d57-e243-434f-a788-041b6466b531) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:40:42 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-31b4a93b-0829-4652-af65-12289c642d4a tempest-VolumesTransfersTest-1143387533 None] Created volume successfully.
Nov 05 09:40:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-90c4f71f-f2da-41a6-8345-0bb2dcf94398 tempest-VolumesTransfersTest-919722067 None] Acquiring lock "cinder-795c9bf9-261e-47a1-ae99-dc4e009cb139-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:40:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-90c4f71f-f2da-41a6-8345-0bb2dcf94398 tempest-VolumesTransfersTest-919722067 None] Lock "cinder-795c9bf9-261e-47a1-ae99-dc4e009cb139-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:40:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-90c4f71f-f2da-41a6-8345-0bb2dcf94398 tempest-VolumesTransfersTest-919722067 None] Acquiring lock "cinder-quobyte-795c9bf9-261e-47a1-ae99-dc4e009cb139" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:40:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-90c4f71f-f2da-41a6-8345-0bb2dcf94398 tempest-VolumesTransfersTest-919722067 None] Lock "cinder-quobyte-795c9bf9-261e-47a1-ae99-dc4e009cb139" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:40:43 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[5265df44-d46d-491e-a756-e650573977ab]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:40:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-90c4f71f-f2da-41a6-8345-0bb2dcf94398 tempest-VolumesTransfersTest-919722067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-795c9bf9-261e-47a1-ae99-dc4e009cb139 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:40:44 devstack sudo[97699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-795c9bf9-261e-47a1-ae99-dc4e009cb139
Nov 05 09:40:44 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:40:44 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root
Nov 05 09:40:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-90c4f71f-f2da-41a6-8345-0bb2dcf94398 tempest-VolumesTransfersTest-919722067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-795c9bf9-261e-47a1-ae99-dc4e009cb139" returned: 0 in 0.406s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:40:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-90c4f71f-f2da-41a6-8345-0bb2dcf94398 tempest-VolumesTransfersTest-919722067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-795c9bf9-261e-47a1-ae99-dc4e009cb139 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:40:44 devstack sudo[97704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-795c9bf9-261e-47a1-ae99-dc4e009cb139
Nov 05 09:40:44 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:40:44 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root
Nov 05 09:40:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-90c4f71f-f2da-41a6-8345-0bb2dcf94398 tempest-VolumesTransfersTest-919722067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-795c9bf9-261e-47a1-ae99-dc4e009cb139" returned: 0 in 0.275s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:40:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-90c4f71f-f2da-41a6-8345-0bb2dcf94398 tempest-VolumesTransfersTest-919722067 None] Lock "cinder-quobyte-795c9bf9-261e-47a1-ae99-dc4e009cb139" released by "delete_volume" :: held 0.739s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:40:44 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-90c4f71f-f2da-41a6-8345-0bb2dcf94398 tempest-VolumesTransfersTest-919722067 None] Created reservations ['8ba703c6-7f14-4f66-a3ff-97826cd62266', '66f02209-ed8d-4694-b4f6-5f1786fa94dd', '5011ae59-aca4-4482-9770-104d43922f6f', '4db5cc7e-9df2-4dbc-ab3d-62709e8cca5b'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:40:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-90c4f71f-f2da-41a6-8345-0bb2dcf94398 tempest-VolumesTransfersTest-919722067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:40:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-90c4f71f-f2da-41a6-8345-0bb2dcf94398 tempest-VolumesTransfersTest-919722067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:40:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-90c4f71f-f2da-41a6-8345-0bb2dcf94398 tempest-VolumesTransfersTest-919722067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:40:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-90c4f71f-f2da-41a6-8345-0bb2dcf94398 tempest-VolumesTransfersTest-919722067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:40:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-90c4f71f-f2da-41a6-8345-0bb2dcf94398 tempest-VolumesTransfersTest-919722067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:40:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-90c4f71f-f2da-41a6-8345-0bb2dcf94398 tempest-VolumesTransfersTest-919722067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:40:44 devstack sudo[97707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:40:44 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:40:45 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root
Nov 05 09:40:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-90c4f71f-f2da-41a6-8345-0bb2dcf94398 tempest-VolumesTransfersTest-919722067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.309s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:40:45 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-90c4f71f-f2da-41a6-8345-0bb2dcf94398 tempest-VolumesTransfersTest-919722067 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:40:45 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-90c4f71f-f2da-41a6-8345-0bb2dcf94398 tempest-VolumesTransfersTest-919722067 None] Deleted volume successfully.
Nov 05 09:40:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-90c4f71f-f2da-41a6-8345-0bb2dcf94398 tempest-VolumesTransfersTest-919722067 None] Lock "cinder-795c9bf9-261e-47a1-ae99-dc4e009cb139-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:40:54 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=30,cinder:UPDATE=37,cinder:INSERT=12,cinder:DELETE=2 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:40:55 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=32,cinder:SELECT=28,cinder:INSERT=16,cinder:DELETE=4 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:00 devstack sudo[97712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:41:00 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] Flow 'volume_create_manager' (a25589dc-8431-4960-aa98-32cd35629686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34141d0b-1c68-4ab3-9761-ed46bd74cdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34141d0b-1c68-4ab3-9761-ed46bd74cdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-387534505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63cd6dc8-a2c4-4e03-976c-47f252fdd062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2f1f26a814e4c76bc99393c2ff1c2d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:41:00Z,use_quota=True,user_id='067292e0c8304d228400c1fa7e335d46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df3cab5c-9b77-4aa3-9498-dced956f082b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df3cab5c-9b77-4aa3-9498-dced956f082b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (199d8620-f6e9-45fe-b645-7dd352d67dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (199d8620-f6e9-45fe-b645-7dd352d67dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63cd6dc8-a2c4-4e03-976c-47f252fdd062', 'volume_name': 'volume-63cd6dc8-a2c4-4e03-976c-47f252fdd062', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82430ade-f9ee-41f6-96e4-26d3d3cf026a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82430ade-f9ee-41f6-96e4-26d3d3cf026a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33f48262-4b38-45ae-aef8-34c463c7655e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:00 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] Volume 63cd6dc8-a2c4-4e03-976c-47f252fdd062: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63cd6dc8-a2c4-4e03-976c-47f252fdd062', 'volume_size': 1}
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-387534505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63cd6dc8-a2c4-4e03-976c-47f252fdd062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2f1f26a814e4c76bc99393c2ff1c2d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:41:00Z,use_quota=True,user_id='067292e0c8304d228400c1fa7e335d46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] Creating volume 63cd6dc8-a2c4-4e03-976c-47f252fdd062 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:41:00 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-63cd6dc8-a2c4-4e03-976c-47f252fdd062 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:00 devstack sudo[97714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-63cd6dc8-a2c4-4e03-976c-47f252fdd062 1073741824
Nov 05 09:41:00 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:00 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.303s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 28 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>, <Thread(tpool_thread_0, started daemon 132223357408960)>, <Thread(tpool_thread_1, started daemon 132223349016256)>, <Thread(tpool_thread_2, started daemon 132223340623552)>, <Thread(tpool_thread_3, started daemon 132223332230848)>, <Thread(tpool_thread_4, started daemon 132223323838144)>, <Thread(tpool_thread_5, started daemon 132223315445440)>, <Thread(tpool_thread_6, started daemon 132223307052736)>, <Thread(tpool_thread_7, started daemon 132223298660032)>, <Thread(tpool_thread_8, started daemon 132223290250944)>, <Thread(tpool_thread_9, started daemon 132223281841856)>, <Thread(tpool_thread_10, started daemon 132223273432768)>, <Thread(tpool_thread_11, started daemon 132223265023680)>, <Thread(tpool_thread_12, started daemon 132223256614592)>, <Thread(tpool_thread_13, started daemon 132223248205504)>, <Thread(tpool_thread_14, started daemon 132223239796416)>, <Thread(tpool_thread_15, started daemon 132223231387328)>, <Thread(tpool_thread_16, started daemon 132223222978240)>, <Thread(tpool_thread_17, started daemon 132223214569152)>, <Thread(tpool_thread_18, started daemon 132223206160064)>, <Thread(tpool_thread_19, started daemon 132223197750976)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:41:00 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-63cd6dc8-a2c4-4e03-976c-47f252fdd062 1073741824" returned: 0 in 0.473s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-63cd6dc8-a2c4-4e03-976c-47f252fdd062 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:00 devstack sudo[97721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-63cd6dc8-a2c4-4e03-976c-47f252fdd062
Nov 05 09:41:00 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:01 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-63cd6dc8-a2c4-4e03-976c-47f252fdd062" returned: 0 in 0.281s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:41:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:41:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33f48262-4b38-45ae-aef8-34c463c7655e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63cd6dc8-a2c4-4e03-976c-47f252fdd062', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (724ac968-62f9-4027-8bf7-6e3ee4be5a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:01 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] Volume volume-63cd6dc8-a2c4-4e03-976c-47f252fdd062 (63cd6dc8-a2c4-4e03-976c-47f252fdd062): created successfully
Nov 05 09:41:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (724ac968-62f9-4027-8bf7-6e3ee4be5a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] Flow 'volume_create_manager' (a25589dc-8431-4960-aa98-32cd35629686) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:41:01 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-4a0faa85-70fe-41c7-abc1-58777c5b2501 tempest-TestImageHashVerification-599317868 None] Created volume successfully.
Nov 05 09:41:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-462c85b4-f592-4d01-8b6c-4f8eda8c08cc tempest-TestImageHashVerification-599317868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:41:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-462c85b4-f592-4d01-8b6c-4f8eda8c08cc tempest-TestImageHashVerification-599317868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.017s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:41:03 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a655b4-55a3-487b-9ec5-3cfcbc0aee36]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:41:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-462c85b4-f592-4d01-8b6c-4f8eda8c08cc tempest-TestImageHashVerification-599317868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-63cd6dc8-a2c4-4e03-976c-47f252fdd062 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:03 devstack sudo[97724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-63cd6dc8-a2c4-4e03-976c-47f252fdd062
Nov 05 09:41:03 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:03 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-462c85b4-f592-4d01-8b6c-4f8eda8c08cc tempest-TestImageHashVerification-599317868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-63cd6dc8-a2c4-4e03-976c-47f252fdd062" returned: 0 in 0.527s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:03 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2207307-9a85-4a3d-8065-fb0b3bfd9f3e]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:41:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-462c85b4-f592-4d01-8b6c-4f8eda8c08cc tempest-TestImageHashVerification-599317868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-63cd6dc8-a2c4-4e03-976c-47f252fdd062 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:04 devstack sudo[97729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-63cd6dc8-a2c4-4e03-976c-47f252fdd062
Nov 05 09:41:04 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:04 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-462c85b4-f592-4d01-8b6c-4f8eda8c08cc tempest-TestImageHashVerification-599317868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-63cd6dc8-a2c4-4e03-976c-47f252fdd062" returned: 0 in 0.436s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-462c85b4-f592-4d01-8b6c-4f8eda8c08cc tempest-TestImageHashVerification-599317868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-63cd6dc8-a2c4-4e03-976c-47f252fdd062 /opt/stack/data/cinder/conversion/63cd6dc8-a2c4-4e03-976c-47f252fdd062.temp_image.50d46a3b-4875-439c-869d-dd6216232360rqhshq1w.img {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:04 devstack sudo[97734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-63cd6dc8-a2c4-4e03-976c-47f252fdd062 /opt/stack/data/cinder/conversion/63cd6dc8-a2c4-4e03-976c-47f252fdd062.temp_image.50d46a3b-4875-439c-869d-dd6216232360rqhshq1w.img
Nov 05 09:41:04 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:11 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:41:12 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-462c85b4-f592-4d01-8b6c-4f8eda8c08cc tempest-TestImageHashVerification-599317868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-63cd6dc8-a2c4-4e03-976c-47f252fdd062 /opt/stack/data/cinder/conversion/63cd6dc8-a2c4-4e03-976c-47f252fdd062.temp_image.50d46a3b-4875-439c-869d-dd6216232360rqhshq1w.img" returned: 0 in 7.715s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:12 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[917f9a3c-286e-4e07-9f70-0c1bbca39564]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:41:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-462c85b4-f592-4d01-8b6c-4f8eda8c08cc tempest-TestImageHashVerification-599317868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-63cd6dc8-a2c4-4e03-976c-47f252fdd062 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:12 devstack sudo[97759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-63cd6dc8-a2c4-4e03-976c-47f252fdd062
Nov 05 09:41:12 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:12 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-462c85b4-f592-4d01-8b6c-4f8eda8c08cc tempest-TestImageHashVerification-599317868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-63cd6dc8-a2c4-4e03-976c-47f252fdd062" returned: 0 in 0.591s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:12 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-462c85b4-f592-4d01-8b6c-4f8eda8c08cc tempest-TestImageHashVerification-599317868 None] Image conversion details: src /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-63cd6dc8-a2c4-4e03-976c-47f252fdd062, size 1024.00 MB, duration 7.72 sec, destination /opt/stack/data/cinder/conversion/63cd6dc8-a2c4-4e03-976c-47f252fdd062.temp_image.50d46a3b-4875-439c-869d-dd6216232360rqhshq1w.img {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 09:41:12 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-462c85b4-f592-4d01-8b6c-4f8eda8c08cc tempest-TestImageHashVerification-599317868 None] Converted 1024.00 MB image at 132.70 MB/s
Nov 05 09:41:12 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-462c85b4-f592-4d01-8b6c-4f8eda8c08cc tempest-TestImageHashVerification-599317868 None] 50d46a3b-4875-439c-869d-dd6216232360 was raw, no need to convert to raw {{(pid=86649) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 05 09:41:21 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:41:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] Flow 'volume_create_manager' (26862733-732d-4a92-aa55-b3ef92ced211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:41:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc7f023d-2118-4b4d-a184-26ff1b436bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc7f023d-2118-4b4d-a184-26ff1b436bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-285907892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57af1afa-f2d0-4f37-b057-cb94bc45924c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d052f87dcf3496dbb73703ccbedbd64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:41:22Z,use_quota=True,user_id='d6577ece2425415fb1ca71aca74358a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7119b494-8e7d-4942-a1c6-287f7e85685f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7119b494-8e7d-4942-a1c6-287f7e85685f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d20b12e-f998-4b3d-8a8b-63c5de0f4f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d20b12e-f998-4b3d-8a8b-63c5de0f4f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57af1afa-f2d0-4f37-b057-cb94bc45924c', 'volume_name': 'volume-57af1afa-f2d0-4f37-b057-cb94bc45924c', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ac9d791-495e-4eb8-89bd-c614bed4f368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ac9d791-495e-4eb8-89bd-c614bed4f368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb66539-8384-4780-bccb-a75c0ea10a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:21 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] Volume 57af1afa-f2d0-4f37-b057-cb94bc45924c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57af1afa-f2d0-4f37-b057-cb94bc45924c', 'volume_size': 1}
Nov 05 09:41:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:41:22 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:41:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Flow 'volume_create_manager' (ac3f922e-92fc-4acf-a986-476550c859b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:41:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd1eee6e-ef60-42ea-a74a-22cef0a5cdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd1eee6e-ef60-42ea-a74a-22cef0a5cdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-922068649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49468252-add1-4f82-b8ae-2a977f9a2cb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='007498b3dd714a8e904f724b72c65dfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:41:23Z,use_quota=True,user_id='4a85e7a9c0a54b7687e731036955e03e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e485262-d6b3-473d-977c-aa6b671df041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e485262-d6b3-473d-977c-aa6b671df041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70edd902-c9e5-4867-8620-578d568a7e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:22 devstack cinder-volume[86649]: DEBUG cinder.image.glance [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Creating Keystone auth plugin from conf {{(pid=86649) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 09:41:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70edd902-c9e5-4867-8620-578d568a7e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '49468252-add1-4f82-b8ae-2a977f9a2cb4', 'volume_name': 'volume-49468252-add1-4f82-b8ae-2a977f9a2cb4', 'volume_size': 1, 'image_id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ccc0fd9-02f4-4820-84b7-775604485a72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '407fc75c86be40efb1fcfded98df545b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'created_at': datetime.datetime(2026, 11, 5, 8, 20, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 8, 20, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ccc0fd9-02f4-4820-84b7-775604485a72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7841a6588b60>}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52589c57-4cc7-4082-8ed0-a0f59b5ebbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52589c57-4cc7-4082-8ed0-a0f59b5ebbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (192f6c83-e242-4ca0-9896-f32681dca1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:23 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Volume 49468252-add1-4f82-b8ae-2a977f9a2cb4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-49468252-add1-4f82-b8ae-2a977f9a2cb4', 'volume_size': 1, 'image_id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ccc0fd9-02f4-4820-84b7-775604485a72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '407fc75c86be40efb1fcfded98df545b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'created_at': datetime.datetime(2026, 11, 5, 8, 20, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 8, 20, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ccc0fd9-02f4-4820-84b7-775604485a72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7841a6588b60>}
Nov 05 09:41:23 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Trying to clone 49468252-add1-4f82-b8ae-2a977f9a2cb4 from image 7ccc0fd9-02f4-4820-84b7-775604485a72 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7ccc0fd9-02f4-4820-84b7-775604485a72', 'metadata': {}}]). {{(pid=86649) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 09:41:23 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_e4cqiscodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 09:41:23 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 09:41:23 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4655a8-4469-43b4-8ea2-1730541a3d47]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:41:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_e4cqiscodevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:23 devstack sudo[97767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_e4cqiscodevstack@QuobyteHD
Nov 05 09:41:23 devstack sudo[97767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:23 devstack sudo[97767]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_e4cqiscodevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:23 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Temporary image 7ccc0fd9-02f4-4820-84b7-775604485a72 is fetched for user 4a85e7a9c0a54b7687e731036955e03e. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 09:41:23 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a057d7-18f7-40d8-b985-1062e68bfdec]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:41:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_e4cqiscodevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:24 devstack sudo[97772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_e4cqiscodevstack@QuobyteHD
Nov 05 09:41:24 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:24 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_e4cqiscodevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:41:33 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=4,cinder:SELECT=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:41:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-462c85b4-f592-4d01-8b6c-4f8eda8c08cc tempest-TestImageHashVerification-599317868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.766s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-462c85b4-f592-4d01-8b6c-4f8eda8c08cc tempest-TestImageHashVerification-599317868 None] Uploaded volume to glance image-id: 50d46a3b-4875-439c-869d-dd6216232360. {{(pid=86649) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 05 09:41:34 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1,cinder:INSERT=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:41:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.177s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-285907892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57af1afa-f2d0-4f37-b057-cb94bc45924c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d052f87dcf3496dbb73703ccbedbd64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:41:22Z,use_quota=True,user_id='d6577ece2425415fb1ca71aca74358a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] Creating volume 57af1afa-f2d0-4f37-b057-cb94bc45924c {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:41:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:41:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:41:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:41:34 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:41:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57af1afa-f2d0-4f37-b057-cb94bc45924c 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:34 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-462c85b4-f592-4d01-8b6c-4f8eda8c08cc tempest-TestImageHashVerification-599317868 None] Copy volume to image completed successfully.
Nov 05 09:41:34 devstack sudo[97782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57af1afa-f2d0-4f37-b057-cb94bc45924c 1073741824
Nov 05 09:41:34 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:34 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57af1afa-f2d0-4f37-b057-cb94bc45924c 1073741824" returned: 0 in 0.469s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57af1afa-f2d0-4f37-b057-cb94bc45924c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:34 devstack sudo[97787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57af1afa-f2d0-4f37-b057-cb94bc45924c
Nov 05 09:41:34 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:34 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57af1afa-f2d0-4f37-b057-cb94bc45924c" returned: 0 in 0.253s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:41:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:41:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.497s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-922068649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49468252-add1-4f82-b8ae-2a977f9a2cb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='007498b3dd714a8e904f724b72c65dfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:41:23Z,use_quota=True,user_id='4a85e7a9c0a54b7687e731036955e03e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Creating volume 49468252-add1-4f82-b8ae-2a977f9a2cb4 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:41:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:41:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:41:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:41:34 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:41:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49468252-add1-4f82-b8ae-2a977f9a2cb4 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:34 devstack sudo[97790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49468252-add1-4f82-b8ae-2a977f9a2cb4 1073741824
Nov 05 09:41:34 devstack sudo[97790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb66539-8384-4780-bccb-a75c0ea10a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57af1afa-f2d0-4f37-b057-cb94bc45924c', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c1ea67d-e6e7-4430-ad3e-7664c30ca1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:34 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] Volume volume-57af1afa-f2d0-4f37-b057-cb94bc45924c (57af1afa-f2d0-4f37-b057-cb94bc45924c): created successfully
Nov 05 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c1ea67d-e6e7-4430-ad3e-7664c30ca1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] Flow 'volume_create_manager' (26862733-732d-4a92-aa55-b3ef92ced211) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:41:34 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-413dd003-a755-4019-8c94-328e8f885791 tempest-VolumesListTestJSON-621422785 None] Created volume successfully.
Nov 05 09:41:35 devstack sudo[97790]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49468252-add1-4f82-b8ae-2a977f9a2cb4 1073741824" returned: 0 in 0.512s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49468252-add1-4f82-b8ae-2a977f9a2cb4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:35 devstack sudo[97796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49468252-add1-4f82-b8ae-2a977f9a2cb4
Nov 05 09:41:35 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-89e2efdf-46dd-478c-a0f3-00e6b1507dc0 tempest-TestImageHashVerification-599317868 None] Acquiring lock "cinder-63cd6dc8-a2c4-4e03-976c-47f252fdd062-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:41:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-89e2efdf-46dd-478c-a0f3-00e6b1507dc0 tempest-TestImageHashVerification-599317868 None] Lock "cinder-63cd6dc8-a2c4-4e03-976c-47f252fdd062-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:41:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-89e2efdf-46dd-478c-a0f3-00e6b1507dc0 tempest-TestImageHashVerification-599317868 None] Acquiring lock "cinder-quobyte-63cd6dc8-a2c4-4e03-976c-47f252fdd062" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:41:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-89e2efdf-46dd-478c-a0f3-00e6b1507dc0 tempest-TestImageHashVerification-599317868 None] Lock "cinder-quobyte-63cd6dc8-a2c4-4e03-976c-47f252fdd062" acquired by "delete_volume" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:41:35 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f307499-4b50-42b5-a6a7-5ef1c833e16e]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:41:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-89e2efdf-46dd-478c-a0f3-00e6b1507dc0 tempest-TestImageHashVerification-599317868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-63cd6dc8-a2c4-4e03-976c-47f252fdd062 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:35 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49468252-add1-4f82-b8ae-2a977f9a2cb4" returned: 0 in 0.332s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:41:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:41:35 devstack sudo[97798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-63cd6dc8-a2c4-4e03-976c-47f252fdd062
Nov 05 09:41:35 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:35 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Attempting download of 7ccc0fd9-02f4-4820-84b7-775604485a72 ((None, [{'url': 'file:///opt/stack/data/glance/images/7ccc0fd9-02f4-4820-84b7-775604485a72', 'metadata': {}}])) to volume 49468252-add1-4f82-b8ae-2a977f9a2cb4. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 09:41:35 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[237e3406-eafd-4a01-be06-f7ea5088568d]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:41:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_z9wz6jor {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:35 devstack sudo[97801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_z9wz6jor
Nov 05 09:41:35 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:36 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-89e2efdf-46dd-478c-a0f3-00e6b1507dc0 tempest-TestImageHashVerification-599317868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-63cd6dc8-a2c4-4e03-976c-47f252fdd062" returned: 0 in 0.491s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-89e2efdf-46dd-478c-a0f3-00e6b1507dc0 tempest-TestImageHashVerification-599317868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-63cd6dc8-a2c4-4e03-976c-47f252fdd062 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:36 devstack sudo[97806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-63cd6dc8-a2c4-4e03-976c-47f252fdd062
Nov 05 09:41:36 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] Flow 'volume_create_manager' (059e9b9f-3b32-4e6c-8955-ccf6f754bace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19481734-2fec-4f1e-abf2-9613902e60a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:36 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19481734-2fec-4f1e-abf2-9613902e60a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1372081919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bea9c58-1d64-4458-a829-8efdba49602c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d052f87dcf3496dbb73703ccbedbd64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:41:36Z,use_quota=True,user_id='d6577ece2425415fb1ca71aca74358a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b19083f-9702-4d76-9ad3-f9da9072be3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b19083f-9702-4d76-9ad3-f9da9072be3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85362c94-0871-40e6-9a31-a2f32a624272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85362c94-0871-40e6-9a31-a2f32a624272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bea9c58-1d64-4458-a829-8efdba49602c', 'volume_name': 'volume-5bea9c58-1d64-4458-a829-8efdba49602c', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc42da6-0fcc-4227-9ed7-fb7802a4774d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc42da6-0fcc-4227-9ed7-fb7802a4774d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (439aa4cb-41be-4ab5-8f95-d6930e0c02fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:36 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] Volume 5bea9c58-1d64-4458-a829-8efdba49602c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bea9c58-1d64-4458-a829-8efdba49602c', 'volume_size': 1}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1372081919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bea9c58-1d64-4458-a829-8efdba49602c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d052f87dcf3496dbb73703ccbedbd64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:41:36Z,use_quota=True,user_id='d6577ece2425415fb1ca71aca74358a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] Creating volume 5bea9c58-1d64-4458-a829-8efdba49602c {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:41:36 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5bea9c58-1d64-4458-a829-8efdba49602c 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_z9wz6jor" returned: 0 in 0.464s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_z9wz6jor {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:36 devstack sudo[97810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5bea9c58-1d64-4458-a829-8efdba49602c 1073741824
Nov 05 09:41:36 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:36 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-89e2efdf-46dd-478c-a0f3-00e6b1507dc0 tempest-TestImageHashVerification-599317868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-63cd6dc8-a2c4-4e03-976c-47f252fdd062" returned: 0 in 0.276s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-89e2efdf-46dd-478c-a0f3-00e6b1507dc0 tempest-TestImageHashVerification-599317868 None] Lock "cinder-quobyte-63cd6dc8-a2c4-4e03-976c-47f252fdd062" released by "delete_volume" :: held 0.830s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:41:36 devstack sudo[97811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_z9wz6jor
Nov 05 09:41:36 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-89e2efdf-46dd-478c-a0f3-00e6b1507dc0 tempest-TestImageHashVerification-599317868 None] Created reservations ['dc08bba7-083c-40a2-94ea-3547dffe3fa5', 'c8be1583-3292-402c-b18f-e0f080274568', '87274d05-9317-4452-8529-7b85d4844b1a', 'e976ad64-2506-4734-8131-bec3fe8bedb2'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-89e2efdf-46dd-478c-a0f3-00e6b1507dc0 tempest-TestImageHashVerification-599317868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-89e2efdf-46dd-478c-a0f3-00e6b1507dc0 tempest-TestImageHashVerification-599317868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-89e2efdf-46dd-478c-a0f3-00e6b1507dc0 tempest-TestImageHashVerification-599317868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-89e2efdf-46dd-478c-a0f3-00e6b1507dc0 tempest-TestImageHashVerification-599317868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-89e2efdf-46dd-478c-a0f3-00e6b1507dc0 tempest-TestImageHashVerification-599317868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-89e2efdf-46dd-478c-a0f3-00e6b1507dc0 tempest-TestImageHashVerification-599317868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:36 devstack sudo[97817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:41:36 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:36 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_z9wz6jor" returned: 1 in 0.367s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_z9wz6jor' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5c5d2d-cac0-4bb3-8a9c-675d76ee8fc6]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_e4cqiscodevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:36 devstack sudo[97822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_e4cqiscodevstack@QuobyteHD
Nov 05 09:41:36 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:36 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-89e2efdf-46dd-478c-a0f3-00e6b1507dc0 tempest-TestImageHashVerification-599317868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.329s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-89e2efdf-46dd-478c-a0f3-00e6b1507dc0 tempest-TestImageHashVerification-599317868 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:41:36 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-89e2efdf-46dd-478c-a0f3-00e6b1507dc0 tempest-TestImageHashVerification-599317868 None] Deleted volume successfully.
Nov 05 09:41:36 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5bea9c58-1d64-4458-a829-8efdba49602c 1073741824" returned: 0 in 0.598s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-89e2efdf-46dd-478c-a0f3-00e6b1507dc0 tempest-TestImageHashVerification-599317868 None] Lock "cinder-63cd6dc8-a2c4-4e03-976c-47f252fdd062-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:41:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5bea9c58-1d64-4458-a829-8efdba49602c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:36 devstack sudo[97825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5bea9c58-1d64-4458-a829-8efdba49602c
Nov 05 09:41:36 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:37 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_e4cqiscodevstack@QuobyteHD" returned: 0 in 0.439s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:37 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] 7ccc0fd9-02f4-4820-84b7-775604485a72 was qcow2, converting to qcow2 {{(pid=86649) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 09:41:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_e4cqiscodevstack@QuobyteHD /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49468252-add1-4f82-b8ae-2a977f9a2cb4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:37 devstack sudo[97830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_e4cqiscodevstack@QuobyteHD /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49468252-add1-4f82-b8ae-2a977f9a2cb4
Nov 05 09:41:37 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:37 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5bea9c58-1d64-4458-a829-8efdba49602c" returned: 0 in 0.321s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:41:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:41:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (439aa4cb-41be-4ab5-8f95-d6930e0c02fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bea9c58-1d64-4458-a829-8efdba49602c', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b81caf-4197-4892-9808-b074d7aed798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:37 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] Volume volume-5bea9c58-1d64-4458-a829-8efdba49602c (5bea9c58-1d64-4458-a829-8efdba49602c): created successfully
Nov 05 09:41:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b81caf-4197-4892-9808-b074d7aed798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] Flow 'volume_create_manager' (059e9b9f-3b32-4e6c-8955-ccf6f754bace) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:41:37 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-08f60c92-f9b0-4b6e-ae98-b892fee04b24 tempest-VolumesListTestJSON-621422785 None] Created volume successfully.
Nov 05 09:41:39 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:41:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] Flow 'volume_create_manager' (d99b04bb-48c5-4ca6-bee8-fe8900b3bf15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:41:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13c7708a-441a-40dd-bb7d-fe8ef41c19ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13c7708a-441a-40dd-bb7d-fe8ef41c19ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-888286629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb5a1446-01ec-487e-b3b8-7a07291f469b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d052f87dcf3496dbb73703ccbedbd64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:41:39Z,use_quota=True,user_id='d6577ece2425415fb1ca71aca74358a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30d28034-9681-4472-8457-a65e14ac0f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30d28034-9681-4472-8457-a65e14ac0f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86bac066-54fd-49c9-a624-463a14189dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86bac066-54fd-49c9-a624-463a14189dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb5a1446-01ec-487e-b3b8-7a07291f469b', 'volume_name': 'volume-bb5a1446-01ec-487e-b3b8-7a07291f469b', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21020648-3d97-4d68-a704-2cbf526683a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21020648-3d97-4d68-a704-2cbf526683a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0379d889-f387-424e-9338-1a749e5f3aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:39 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] Volume bb5a1446-01ec-487e-b3b8-7a07291f469b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb5a1446-01ec-487e-b3b8-7a07291f469b', 'volume_size': 1}
Nov 05 09:41:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:41:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:41:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-888286629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb5a1446-01ec-487e-b3b8-7a07291f469b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d052f87dcf3496dbb73703ccbedbd64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:41:39Z,use_quota=True,user_id='d6577ece2425415fb1ca71aca74358a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:41:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] Creating volume bb5a1446-01ec-487e-b3b8-7a07291f469b {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:41:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:41:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:41:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:41:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:41:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:41:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:41:39 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:41:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5a1446-01ec-487e-b3b8-7a07291f469b 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:39 devstack sudo[97881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5a1446-01ec-487e-b3b8-7a07291f469b 1073741824
Nov 05 09:41:39 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:39 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_e4cqiscodevstack@QuobyteHD /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49468252-add1-4f82-b8ae-2a977f9a2cb4" returned: 0 in 2.363s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:39 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_e4cqiscodevstack@QuobyteHD, size 112.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49468252-add1-4f82-b8ae-2a977f9a2cb4 {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 09:41:39 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Converted 112.00 MB image at 47.37 MB/s
Nov 05 09:41:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49468252-add1-4f82-b8ae-2a977f9a2cb4 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:39 devstack sudo[97886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49468252-add1-4f82-b8ae-2a977f9a2cb4 1G
Nov 05 09:41:39 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:39 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5a1446-01ec-487e-b3b8-7a07291f469b 1073741824" returned: 0 in 0.603s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5a1446-01ec-487e-b3b8-7a07291f469b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:39 devstack sudo[97893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5a1446-01ec-487e-b3b8-7a07291f469b
Nov 05 09:41:39 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:39 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49468252-add1-4f82-b8ae-2a977f9a2cb4 1G" returned: 0 in 0.405s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:39 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Downloaded image 7ccc0fd9-02f4-4820-84b7-775604485a72 ((None, [{'url': 'file:///opt/stack/data/glance/images/7ccc0fd9-02f4-4820-84b7-775604485a72', 'metadata': {}}])) to volume 49468252-add1-4f82-b8ae-2a977f9a2cb4 successfully. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 09:41:39 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Temporary image 7ccc0fd9-02f4-4820-84b7-775604485a72 for user 4a85e7a9c0a54b7687e731036955e03e is deleted. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 09:41:39 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Marking volume 49468252-add1-4f82-b8ae-2a977f9a2cb4 as bootable. {{(pid=86649) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 09:41:39 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Copying metadata from image 7ccc0fd9-02f4-4820-84b7-775604485a72 to 49468252-add1-4f82-b8ae-2a977f9a2cb4. {{(pid=86649) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 09:41:39 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Creating volume glance metadata for volume 49468252-add1-4f82-b8ae-2a977f9a2cb4 backed by image 7ccc0fd9-02f4-4820-84b7-775604485a72 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86649) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 09:41:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (192f6c83-e242-4ca0-9896-f32681dca1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49468252-add1-4f82-b8ae-2a977f9a2cb4', 'volume_size': 1, 'image_id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ccc0fd9-02f4-4820-84b7-775604485a72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '407fc75c86be40efb1fcfded98df545b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'created_at': datetime.datetime(2026, 11, 5, 8, 20, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 8, 20, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ccc0fd9-02f4-4820-84b7-775604485a72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7841a6588b60>}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee419c9-0fa8-4a86-a008-ce80613a08fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:40 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Volume volume-49468252-add1-4f82-b8ae-2a977f9a2cb4 (49468252-add1-4f82-b8ae-2a977f9a2cb4): created successfully
Nov 05 09:41:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee419c9-0fa8-4a86-a008-ce80613a08fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Flow 'volume_create_manager' (ac3f922e-92fc-4acf-a986-476550c859b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:41:40 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-519dcecf-e7c4-4abc-92ee-234759cc0eaa tempest-TestShelveInstance-850736521 None] Created volume successfully.
Nov 05 09:41:40 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5a1446-01ec-487e-b3b8-7a07291f469b" returned: 0 in 0.327s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:41:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:41:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0379d889-f387-424e-9338-1a749e5f3aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb5a1446-01ec-487e-b3b8-7a07291f469b', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d55bc5-bb44-4d2d-93ea-ced9d0633c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:40 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] Volume volume-bb5a1446-01ec-487e-b3b8-7a07291f469b (bb5a1446-01ec-487e-b3b8-7a07291f469b): created successfully
Nov 05 09:41:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d55bc5-bb44-4d2d-93ea-ced9d0633c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] Flow 'volume_create_manager' (d99b04bb-48c5-4ca6-bee8-fe8900b3bf15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:41:40 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-22c99ac1-d336-4ab0-9fc8-e6159471d92e tempest-VolumesListTestJSON-621422785 None] Created volume successfully.
Nov 05 09:41:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d8750289-5a2d-415a-baf3-c0a47f1b65e5 tempest-VolumesListTestJSON-621422785 None] Acquiring lock "cinder-bb5a1446-01ec-487e-b3b8-7a07291f469b-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:41:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d8750289-5a2d-415a-baf3-c0a47f1b65e5 tempest-VolumesListTestJSON-621422785 None] Lock "cinder-bb5a1446-01ec-487e-b3b8-7a07291f469b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:41:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d8750289-5a2d-415a-baf3-c0a47f1b65e5 tempest-VolumesListTestJSON-621422785 None] Acquiring lock "cinder-quobyte-bb5a1446-01ec-487e-b3b8-7a07291f469b" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:41:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d8750289-5a2d-415a-baf3-c0a47f1b65e5 tempest-VolumesListTestJSON-621422785 None] Lock "cinder-quobyte-bb5a1446-01ec-487e-b3b8-7a07291f469b" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:41:44 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d6f18f-cef1-44c4-adea-f82df2fa7beb]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:41:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d8750289-5a2d-415a-baf3-c0a47f1b65e5 tempest-VolumesListTestJSON-621422785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5a1446-01ec-487e-b3b8-7a07291f469b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:44 devstack sudo[97904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5a1446-01ec-487e-b3b8-7a07291f469b
Nov 05 09:41:44 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:44 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d8750289-5a2d-415a-baf3-c0a47f1b65e5 tempest-VolumesListTestJSON-621422785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5a1446-01ec-487e-b3b8-7a07291f469b" returned: 0 in 0.397s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d8750289-5a2d-415a-baf3-c0a47f1b65e5 tempest-VolumesListTestJSON-621422785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5a1446-01ec-487e-b3b8-7a07291f469b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:44 devstack sudo[97909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5a1446-01ec-487e-b3b8-7a07291f469b
Nov 05 09:41:44 devstack sudo[97909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:44 devstack sudo[97909]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d8750289-5a2d-415a-baf3-c0a47f1b65e5 tempest-VolumesListTestJSON-621422785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bb5a1446-01ec-487e-b3b8-7a07291f469b" returned: 0 in 0.259s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d8750289-5a2d-415a-baf3-c0a47f1b65e5 tempest-VolumesListTestJSON-621422785 None] Lock "cinder-quobyte-bb5a1446-01ec-487e-b3b8-7a07291f469b" released by "delete_volume" :: held 0.707s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:41:44 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-d8750289-5a2d-415a-baf3-c0a47f1b65e5 tempest-VolumesListTestJSON-621422785 None] Created reservations ['d395f9df-8370-4675-b302-a33c022a5efa', '593b61a9-7b3e-4e74-bc6c-ca94554f6a4f', 'd0765f84-1091-4453-a1ee-5b1e91a62c43', '5001ed6b-153a-4959-843a-cbe7421177c3'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:41:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d8750289-5a2d-415a-baf3-c0a47f1b65e5 tempest-VolumesListTestJSON-621422785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:41:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d8750289-5a2d-415a-baf3-c0a47f1b65e5 tempest-VolumesListTestJSON-621422785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:41:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d8750289-5a2d-415a-baf3-c0a47f1b65e5 tempest-VolumesListTestJSON-621422785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:41:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d8750289-5a2d-415a-baf3-c0a47f1b65e5 tempest-VolumesListTestJSON-621422785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:41:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d8750289-5a2d-415a-baf3-c0a47f1b65e5 tempest-VolumesListTestJSON-621422785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:41:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d8750289-5a2d-415a-baf3-c0a47f1b65e5 tempest-VolumesListTestJSON-621422785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:44 devstack sudo[97912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:41:44 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:45 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d8750289-5a2d-415a-baf3-c0a47f1b65e5 tempest-VolumesListTestJSON-621422785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.291s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:45 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d8750289-5a2d-415a-baf3-c0a47f1b65e5 tempest-VolumesListTestJSON-621422785 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:41:45 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-d8750289-5a2d-415a-baf3-c0a47f1b65e5 tempest-VolumesListTestJSON-621422785 None] Deleted volume successfully.
Nov 05 09:41:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-938604b3-2cac-4fe0-935d-d049f7ca984a tempest-VolumesListTestJSON-621422785 None] Acquiring lock "cinder-5bea9c58-1d64-4458-a829-8efdba49602c-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:41:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d8750289-5a2d-415a-baf3-c0a47f1b65e5 tempest-VolumesListTestJSON-621422785 None] Lock "cinder-bb5a1446-01ec-487e-b3b8-7a07291f469b-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:41:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-938604b3-2cac-4fe0-935d-d049f7ca984a tempest-VolumesListTestJSON-621422785 None] Lock "cinder-5bea9c58-1d64-4458-a829-8efdba49602c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:41:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-938604b3-2cac-4fe0-935d-d049f7ca984a tempest-VolumesListTestJSON-621422785 None] Acquiring lock "cinder-quobyte-5bea9c58-1d64-4458-a829-8efdba49602c" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:41:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-938604b3-2cac-4fe0-935d-d049f7ca984a tempest-VolumesListTestJSON-621422785 None] Lock "cinder-quobyte-5bea9c58-1d64-4458-a829-8efdba49602c" acquired by "delete_volume" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:41:45 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[402fe5d6-794d-466e-8aed-3ca21508c3d9]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:41:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-938604b3-2cac-4fe0-935d-d049f7ca984a tempest-VolumesListTestJSON-621422785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5bea9c58-1d64-4458-a829-8efdba49602c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:45 devstack sudo[97915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5bea9c58-1d64-4458-a829-8efdba49602c
Nov 05 09:41:45 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:45 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-938604b3-2cac-4fe0-935d-d049f7ca984a tempest-VolumesListTestJSON-621422785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5bea9c58-1d64-4458-a829-8efdba49602c" returned: 0 in 0.383s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-938604b3-2cac-4fe0-935d-d049f7ca984a tempest-VolumesListTestJSON-621422785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5bea9c58-1d64-4458-a829-8efdba49602c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:45 devstack sudo[97920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5bea9c58-1d64-4458-a829-8efdba49602c
Nov 05 09:41:45 devstack sudo[97920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:45 devstack sudo[97920]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-938604b3-2cac-4fe0-935d-d049f7ca984a tempest-VolumesListTestJSON-621422785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5bea9c58-1d64-4458-a829-8efdba49602c" returned: 0 in 0.274s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-938604b3-2cac-4fe0-935d-d049f7ca984a tempest-VolumesListTestJSON-621422785 None] Lock "cinder-quobyte-5bea9c58-1d64-4458-a829-8efdba49602c" released by "delete_volume" :: held 0.704s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:41:46 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-938604b3-2cac-4fe0-935d-d049f7ca984a tempest-VolumesListTestJSON-621422785 None] Created reservations ['1cfc02d7-1622-46f8-b347-8e69df5099e7', '47623969-bb0f-451f-8d4e-1c952ccf377d', 'c3f51e4d-94f3-47fc-af71-1a4d1bd8d9c0', '9ade0449-a71f-4dfd-9d44-aaa2f92efc7c'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:41:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-938604b3-2cac-4fe0-935d-d049f7ca984a tempest-VolumesListTestJSON-621422785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:41:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-938604b3-2cac-4fe0-935d-d049f7ca984a tempest-VolumesListTestJSON-621422785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:41:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-938604b3-2cac-4fe0-935d-d049f7ca984a tempest-VolumesListTestJSON-621422785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:41:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-938604b3-2cac-4fe0-935d-d049f7ca984a tempest-VolumesListTestJSON-621422785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:41:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-938604b3-2cac-4fe0-935d-d049f7ca984a tempest-VolumesListTestJSON-621422785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:41:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-938604b3-2cac-4fe0-935d-d049f7ca984a tempest-VolumesListTestJSON-621422785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:46 devstack sudo[97923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:41:46 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:46 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-938604b3-2cac-4fe0-935d-d049f7ca984a tempest-VolumesListTestJSON-621422785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.287s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:46 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-938604b3-2cac-4fe0-935d-d049f7ca984a tempest-VolumesListTestJSON-621422785 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:41:46 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-938604b3-2cac-4fe0-935d-d049f7ca984a tempest-VolumesListTestJSON-621422785 None] Deleted volume successfully.
Nov 05 09:41:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-938604b3-2cac-4fe0-935d-d049f7ca984a tempest-VolumesListTestJSON-621422785 None] Lock "cinder-5bea9c58-1d64-4458-a829-8efdba49602c-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:41:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fc1b03a2-2198-42b5-9c3a-8e16068dced0 tempest-VolumesListTestJSON-621422785 None] Acquiring lock "cinder-57af1afa-f2d0-4f37-b057-cb94bc45924c-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:41:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fc1b03a2-2198-42b5-9c3a-8e16068dced0 tempest-VolumesListTestJSON-621422785 None] Lock "cinder-57af1afa-f2d0-4f37-b057-cb94bc45924c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:41:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fc1b03a2-2198-42b5-9c3a-8e16068dced0 tempest-VolumesListTestJSON-621422785 None] Acquiring lock "cinder-quobyte-57af1afa-f2d0-4f37-b057-cb94bc45924c" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:41:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fc1b03a2-2198-42b5-9c3a-8e16068dced0 tempest-VolumesListTestJSON-621422785 None] Lock "cinder-quobyte-57af1afa-f2d0-4f37-b057-cb94bc45924c" acquired by "delete_volume" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:41:46 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[170b653e-d3a0-4e14-9a5f-0110084d7bf8]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:41:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fc1b03a2-2198-42b5-9c3a-8e16068dced0 tempest-VolumesListTestJSON-621422785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57af1afa-f2d0-4f37-b057-cb94bc45924c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:46 devstack sudo[97926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57af1afa-f2d0-4f37-b057-cb94bc45924c
Nov 05 09:41:46 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:46 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fc1b03a2-2198-42b5-9c3a-8e16068dced0 tempest-VolumesListTestJSON-621422785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57af1afa-f2d0-4f37-b057-cb94bc45924c" returned: 0 in 0.400s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fc1b03a2-2198-42b5-9c3a-8e16068dced0 tempest-VolumesListTestJSON-621422785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57af1afa-f2d0-4f37-b057-cb94bc45924c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:46 devstack sudo[97931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57af1afa-f2d0-4f37-b057-cb94bc45924c
Nov 05 09:41:46 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:47 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fc1b03a2-2198-42b5-9c3a-8e16068dced0 tempest-VolumesListTestJSON-621422785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-57af1afa-f2d0-4f37-b057-cb94bc45924c" returned: 0 in 0.290s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fc1b03a2-2198-42b5-9c3a-8e16068dced0 tempest-VolumesListTestJSON-621422785 None] Lock "cinder-quobyte-57af1afa-f2d0-4f37-b057-cb94bc45924c" released by "delete_volume" :: held 0.762s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:41:47 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-fc1b03a2-2198-42b5-9c3a-8e16068dced0 tempest-VolumesListTestJSON-621422785 None] Created reservations ['137d14b9-d37a-4393-8259-8fa38e5581c0', '827dbcac-f7ea-4d48-956c-4d42511c17f0', '4342d491-5ae5-4503-b4bb-f006766991c3', '86bdebc4-34af-440e-aade-c017f9f88791'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:41:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fc1b03a2-2198-42b5-9c3a-8e16068dced0 tempest-VolumesListTestJSON-621422785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:41:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fc1b03a2-2198-42b5-9c3a-8e16068dced0 tempest-VolumesListTestJSON-621422785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:41:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fc1b03a2-2198-42b5-9c3a-8e16068dced0 tempest-VolumesListTestJSON-621422785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:41:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fc1b03a2-2198-42b5-9c3a-8e16068dced0 tempest-VolumesListTestJSON-621422785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:41:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fc1b03a2-2198-42b5-9c3a-8e16068dced0 tempest-VolumesListTestJSON-621422785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:41:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fc1b03a2-2198-42b5-9c3a-8e16068dced0 tempest-VolumesListTestJSON-621422785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:47 devstack sudo[97934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:41:47 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:47 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fc1b03a2-2198-42b5-9c3a-8e16068dced0 tempest-VolumesListTestJSON-621422785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.348s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:47 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-fc1b03a2-2198-42b5-9c3a-8e16068dced0 tempest-VolumesListTestJSON-621422785 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:41:47 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-fc1b03a2-2198-42b5-9c3a-8e16068dced0 tempest-VolumesListTestJSON-621422785 None] Deleted volume successfully.
Nov 05 09:41:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fc1b03a2-2198-42b5-9c3a-8e16068dced0 tempest-VolumesListTestJSON-621422785 None] Lock "cinder-57af1afa-f2d0-4f37-b057-cb94bc45924c-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:41:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-a2d5304a-bdf0-461f-8e55-31bbbfcd4de7 req-3806fc7c-f05a-409d-bc97-e2691fa9b5e5 tempest-TestShelveInstance-850736521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:41:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-a2d5304a-bdf0-461f-8e55-31bbbfcd4de7 req-3806fc7c-f05a-409d-bc97-e2691fa9b5e5 tempest-TestShelveInstance-850736521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:41:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-a2d5304a-bdf0-461f-8e55-31bbbfcd4de7 req-3806fc7c-f05a-409d-bc97-e2691fa9b5e5 tempest-TestShelveInstance-850736521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:41:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-a2d5304a-bdf0-461f-8e55-31bbbfcd4de7 req-3806fc7c-f05a-409d-bc97-e2691fa9b5e5 tempest-TestShelveInstance-850736521 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1', 'name': 'volume-49468252-add1-4f82-b8ae-2a977f9a2cb4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f52338be-e6a4-4033-a494-7b6ed7078f66', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 09:41:49 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-a2d5304a-bdf0-461f-8e55-31bbbfcd4de7 req-3806fc7c-f05a-409d-bc97-e2691fa9b5e5 tempest-TestShelveInstance-850736521 None] attachment_update completed successfully.
Nov 05 09:41:52 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:41:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] Flow 'volume_create_manager' (614784ed-264f-42df-9502-239557b3549e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:41:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (849c0790-ffa6-4caa-bcb3-f362f6c78df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (849c0790-ffa6-4caa-bcb3-f362f6c78df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1171874878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee7478b5-2b2d-4529-99fa-4e684bc05c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46916b0397ea4083be1b14c9380e5114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:41:53Z,use_quota=True,user_id='f923e72727964799a4fa9543d5a69677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c2b3d13-3fe6-48c9-ac1b-560227b7db79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c2b3d13-3fe6-48c9-ac1b-560227b7db79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5897c3c-b17c-45df-9326-254804226941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5897c3c-b17c-45df-9326-254804226941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee7478b5-2b2d-4529-99fa-4e684bc05c35', 'volume_name': 'volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f79f947-de12-4bcd-9aea-dd36158bd152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f79f947-de12-4bcd-9aea-dd36158bd152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96343b5-5176-4bcc-90ec-1e235d5aa156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:52 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] Volume ee7478b5-2b2d-4529-99fa-4e684bc05c35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35', 'volume_size': 1}
Nov 05 09:41:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:41:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:41:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1171874878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee7478b5-2b2d-4529-99fa-4e684bc05c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46916b0397ea4083be1b14c9380e5114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:41:53Z,use_quota=True,user_id='f923e72727964799a4fa9543d5a69677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:41:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] Creating volume ee7478b5-2b2d-4529-99fa-4e684bc05c35 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:41:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:41:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:41:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:41:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:41:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:41:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:41:52 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:41:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:52 devstack sudo[97951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35 1073741824
Nov 05 09:41:52 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:53 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35 1073741824" returned: 0 in 0.535s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:53 devstack sudo[97957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35
Nov 05 09:41:53 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:53 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35" returned: 0 in 0.374s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:41:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:41:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96343b5-5176-4bcc-90ec-1e235d5aa156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc45bf8-4bc5-4892-b690-2527765b58b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:53 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] Volume volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35 (ee7478b5-2b2d-4529-99fa-4e684bc05c35): created successfully
Nov 05 09:41:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc45bf8-4bc5-4892-b690-2527765b58b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] Flow 'volume_create_manager' (614784ed-264f-42df-9502-239557b3549e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:41:53 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-0d582a3f-b19a-49d9-9be6-f7b4fcc68fd1 tempest-VolumesSnapshotListTestJSON-1153668159 None] Created volume successfully.
Nov 05 09:41:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2e2f6a06-f3a1-4f17-a451-968445fad10e tempest-VolumesSnapshotListTestJSON-1153668159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:41:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2e2f6a06-f3a1-4f17-a451-968445fad10e tempest-VolumesSnapshotListTestJSON-1153668159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:41:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-2e2f6a06-f3a1-4f17-a451-968445fad10e tempest-VolumesSnapshotListTestJSON-1153668159 None] Creating offline snapshot a0f15d50-d03d-4dd6-82e3-d41829ca9862 of volume ee7478b5-2b2d-4529-99fa-4e684bc05c35 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 09:41:55 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[91783635-56e8-4255-ae0f-a1a095c600ee]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:41:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e2f6a06-f3a1-4f17-a451-968445fad10e tempest-VolumesSnapshotListTestJSON-1153668159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:55 devstack sudo[98434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35
Nov 05 09:41:55 devstack sudo[98434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:56 devstack sudo[98434]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e2f6a06-f3a1-4f17-a451-968445fad10e tempest-VolumesSnapshotListTestJSON-1153668159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35" returned: 0 in 0.565s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e2f6a06-f3a1-4f17-a451-968445fad10e tempest-VolumesSnapshotListTestJSON-1153668159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.a0f15d50-d03d-4dd6-82e3-d41829ca9862 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:56 devstack sudo[98441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.a0f15d50-d03d-4dd6-82e3-d41829ca9862 1G
Nov 05 09:41:56 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:41:56 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] Flow 'volume_create_manager' (a4755ac1-5072-4989-94f5-456e14357389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:41:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (556375bd-1b7f-465f-86a2-4bc3b9988a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (556375bd-1b7f-465f-86a2-4bc3b9988a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-690422742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdeeac4b-f817-4314-bb5c-7e8be7e6241e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383a8e15ad054f108734c6c6830873f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:41:56Z,use_quota=True,user_id='9a3b47f156df4d87ad30a3da2f88b49a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (667e98c9-a36d-4351-a77d-885100c86961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (667e98c9-a36d-4351-a77d-885100c86961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72d6cd80-84f2-4310-8a5c-0629c412d23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72d6cd80-84f2-4310-8a5c-0629c412d23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdeeac4b-f817-4314-bb5c-7e8be7e6241e', 'volume_name': 'volume-cdeeac4b-f817-4314-bb5c-7e8be7e6241e', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbbe8b13-0311-4fb9-ad5c-79c01cc9f48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbbe8b13-0311-4fb9-ad5c-79c01cc9f48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1763ed1d-bcc7-4679-aa6a-f67a289a8558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:56 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] Volume cdeeac4b-f817-4314-bb5c-7e8be7e6241e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdeeac4b-f817-4314-bb5c-7e8be7e6241e', 'volume_size': 1}
Nov 05 09:41:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:41:56 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:41:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] Flow 'volume_create_manager' (c1046f6a-711e-4749-933a-34ee76e93a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:41:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a1cf382-acaf-44dd-817e-c6e68eb2a59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a1cf382-acaf-44dd-817e-c6e68eb2a59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-371817661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb79418-8b1e-4e3a-93de-7393901b48a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383a8e15ad054f108734c6c6830873f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:41:57Z,use_quota=True,user_id='9a3b47f156df4d87ad30a3da2f88b49a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff0ef12f-cd9d-4c66-9740-8426c826d7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff0ef12f-cd9d-4c66-9740-8426c826d7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95cb0594-cbd2-401a-8835-d9e9ed88a391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:56 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95cb0594-cbd2-401a-8835-d9e9ed88a391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbb79418-8b1e-4e3a-93de-7393901b48a3', 'volume_name': 'volume-cbb79418-8b1e-4e3a-93de-7393901b48a3', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a59f158-4ba3-4a67-971f-e67ffefe0417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a59f158-4ba3-4a67-971f-e67ffefe0417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (536e765f-f586-49aa-8b2b-56efb12d46f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:56 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] Volume cbb79418-8b1e-4e3a-93de-7393901b48a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbb79418-8b1e-4e3a-93de-7393901b48a3', 'volume_size': 1}
Nov 05 09:41:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:41:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e2f6a06-f3a1-4f17-a451-968445fad10e tempest-VolumesSnapshotListTestJSON-1153668159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.a0f15d50-d03d-4dd6-82e3-d41829ca9862 1G" returned: 0 in 0.860s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e2f6a06-f3a1-4f17-a451-968445fad10e tempest-VolumesSnapshotListTestJSON-1153668159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.a0f15d50-d03d-4dd6-82e3-d41829ca9862 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:56 devstack sudo[98450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.a0f15d50-d03d-4dd6-82e3-d41829ca9862
Nov 05 09:41:56 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:57 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:41:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] Flow 'volume_create_manager' (80e3e96c-6c1c-4876-8ec0-f2436b1b9235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:41:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1a5bba9-9c6a-448c-9e1f-afe2ff8a2de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:57 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1a5bba9-9c6a-448c-9e1f-afe2ff8a2de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-961073315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a96769e-1f54-4cb3-a018-cf15709f3bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383a8e15ad054f108734c6c6830873f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:41:57Z,use_quota=True,user_id='9a3b47f156df4d87ad30a3da2f88b49a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5af660dd-2079-41a8-9a35-e8afb363f4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5af660dd-2079-41a8-9a35-e8afb363f4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6655fac7-e9f3-411d-b83d-0534e208ca70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6655fac7-e9f3-411d-b83d-0534e208ca70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a96769e-1f54-4cb3-a018-cf15709f3bb6', 'volume_name': 'volume-9a96769e-1f54-4cb3-a018-cf15709f3bb6', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b21a28f-e491-4c4a-8c3f-9c7b39418481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b21a28f-e491-4c4a-8c3f-9c7b39418481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:57 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb4e5bf8-6cc2-401e-9cd5-06d8cf285042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:57 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] Volume 9a96769e-1f54-4cb3-a018-cf15709f3bb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a96769e-1f54-4cb3-a018-cf15709f3bb6', 'volume_size': 1}
Nov 05 09:41:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:41:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e2f6a06-f3a1-4f17-a451-968445fad10e tempest-VolumesSnapshotListTestJSON-1153668159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.a0f15d50-d03d-4dd6-82e3-d41829ca9862" returned: 0 in 0.698s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:57 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-2e2f6a06-f3a1-4f17-a451-968445fad10e tempest-VolumesSnapshotListTestJSON-1153668159 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.a0f15d50-d03d-4dd6-82e3-d41829ca9862 is being set with open permissions: ugo+rw
Nov 05 09:41:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e2f6a06-f3a1-4f17-a451-968445fad10e tempest-VolumesSnapshotListTestJSON-1153668159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.a0f15d50-d03d-4dd6-82e3-d41829ca9862 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:57 devstack sudo[98455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.a0f15d50-d03d-4dd6-82e3-d41829ca9862
Nov 05 09:41:57 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:58 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e2f6a06-f3a1-4f17-a451-968445fad10e tempest-VolumesSnapshotListTestJSON-1153668159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.a0f15d50-d03d-4dd6-82e3-d41829ca9862" returned: 0 in 0.451s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] Flow 'volume_create_manager' (a968ac51-e5d8-4816-bae8-ab035e355f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09694375-ce33-4c67-806b-4c59ee7228d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e2f6a06-f3a1-4f17-a451-968445fad10e tempest-VolumesSnapshotListTestJSON-1153668159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09694375-ce33-4c67-806b-4c59ee7228d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1667433605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f890f05-ed03-49a9-816d-5cf32dae2fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383a8e15ad054f108734c6c6830873f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:41:58Z,use_quota=True,user_id='9a3b47f156df4d87ad30a3da2f88b49a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9b3e541-40cd-486f-9b10-737599847a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:58 devstack sudo[98458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.info
Nov 05 09:41:58 devstack sudo[98458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9b3e541-40cd-486f-9b10-737599847a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e6210d-610b-4b4e-b658-d5b0916c322a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e6210d-610b-4b4e-b658-d5b0916c322a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f890f05-ed03-49a9-816d-5cf32dae2fb6', 'volume_name': 'volume-4f890f05-ed03-49a9-816d-5cf32dae2fb6', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08076c51-4cab-4f37-aec6-3937478fa4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08076c51-4cab-4f37-aec6-3937478fa4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa96b00-a9ac-43ad-b8c5-9852a9b15eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:58 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] Volume 4f890f05-ed03-49a9-816d-5cf32dae2fb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f890f05-ed03-49a9-816d-5cf32dae2fb6', 'volume_size': 1}
Nov 05 09:41:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:41:58 devstack sudo[98458]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e2f6a06-f3a1-4f17-a451-968445fad10e tempest-VolumesSnapshotListTestJSON-1153668159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.info" returned: 0 in 0.464s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:58 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-2e2f6a06-f3a1-4f17-a451-968445fad10e tempest-VolumesSnapshotListTestJSON-1153668159 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.info is being set with open permissions: ugo+rw
Nov 05 09:41:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e2f6a06-f3a1-4f17-a451-968445fad10e tempest-VolumesSnapshotListTestJSON-1153668159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:58 devstack sudo[98461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.info
Nov 05 09:41:58 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] Flow 'volume_create_manager' (fdcf01c8-6f08-414a-b869-e725133c30a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3afb695d-0338-494c-b238-fa8e4484c35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3afb695d-0338-494c-b238-fa8e4484c35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-81906073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8146549-f876-4caf-a56d-265d85a73461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383a8e15ad054f108734c6c6830873f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:41:59Z,use_quota=True,user_id='9a3b47f156df4d87ad30a3da2f88b49a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28cdd116-6c4c-4653-8345-d3fda23958a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28cdd116-6c4c-4653-8345-d3fda23958a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aecf380-1a93-42bd-9104-429dcd8c1092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aecf380-1a93-42bd-9104-429dcd8c1092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8146549-f876-4caf-a56d-265d85a73461', 'volume_name': 'volume-d8146549-f876-4caf-a56d-265d85a73461', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad11da7-f541-4855-812c-76eb1f92527d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad11da7-f541-4855-812c-76eb1f92527d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:41:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e6700e-9914-434e-bd24-83a4f5341b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:41:58 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] Volume d8146549-f876-4caf-a56d-265d85a73461: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8146549-f876-4caf-a56d-265d85a73461', 'volume_size': 1}
Nov 05 09:41:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:41:59 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e2f6a06-f3a1-4f17-a451-968445fad10e tempest-VolumesSnapshotListTestJSON-1153668159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.info" returned: 0 in 0.393s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2e2f6a06-f3a1-4f17-a451-968445fad10e tempest-VolumesSnapshotListTestJSON-1153668159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.673s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:41:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.849s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:41:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-690422742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdeeac4b-f817-4314-bb5c-7e8be7e6241e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383a8e15ad054f108734c6c6830873f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:41:56Z,use_quota=True,user_id='9a3b47f156df4d87ad30a3da2f88b49a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:41:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] Creating volume cdeeac4b-f817-4314-bb5c-7e8be7e6241e {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:41:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:41:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:41:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:41:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:41:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:41:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:41:59 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:41:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cdeeac4b-f817-4314-bb5c-7e8be7e6241e 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:59 devstack sudo[98464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cdeeac4b-f817-4314-bb5c-7e8be7e6241e 1073741824
Nov 05 09:41:59 devstack sudo[98464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:59 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-2e2f6a06-f3a1-4f17-a451-968445fad10e tempest-VolumesSnapshotListTestJSON-1153668159 None] Create snapshot completed successfully
Nov 05 09:41:59 devstack sudo[98464]: pam_unix(sudo:session): session closed for user root
Nov 05 09:41:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cdeeac4b-f817-4314-bb5c-7e8be7e6241e 1073741824" returned: 0 in 0.566s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:41:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cdeeac4b-f817-4314-bb5c-7e8be7e6241e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:41:59 devstack sudo[98472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cdeeac4b-f817-4314-bb5c-7e8be7e6241e
Nov 05 09:41:59 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:41:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a1c3b775-11bf-41ad-89aa-2700179ab390 tempest-VolumesSnapshotListTestJSON-1153668159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:42:00 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cdeeac4b-f817-4314-bb5c-7e8be7e6241e" returned: 0 in 0.427s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:42:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:42:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.222s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:42:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-371817661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb79418-8b1e-4e3a-93de-7393901b48a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383a8e15ad054f108734c6c6830873f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:41:57Z,use_quota=True,user_id='9a3b47f156df4d87ad30a3da2f88b49a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:42:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] Creating volume cbb79418-8b1e-4e3a-93de-7393901b48a3 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:42:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:42:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:42:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:42:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:42:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:42:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:42:00 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:42:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cbb79418-8b1e-4e3a-93de-7393901b48a3 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:42:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:42:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:42:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:42:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:42:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:42:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:00 devstack sudo[98475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cbb79418-8b1e-4e3a-93de-7393901b48a3 1073741824
Nov 05 09:42:00 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1763ed1d-bcc7-4679-aa6a-f67a289a8558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdeeac4b-f817-4314-bb5c-7e8be7e6241e', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:42:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee9d5605-cc17-4118-9e95-6a3387dc24ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:42:00 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] Volume volume-cdeeac4b-f817-4314-bb5c-7e8be7e6241e (cdeeac4b-f817-4314-bb5c-7e8be7e6241e): created successfully
Nov 05 09:42:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee9d5605-cc17-4118-9e95-6a3387dc24ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:42:00 devstack sudo[98476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:42:00 devstack sudo[98476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] Flow 'volume_create_manager' (a4755ac1-5072-4989-94f5-456e14357389) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:42:00 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-2f04c750-233c-47c2-a87f-4604c06b36e0 tempest-CreateVolumesFromImageTest-1847404906 None] Created volume successfully.
Nov 05 09:42:00 devstack sudo[98476]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.492s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:42:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:42:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 28 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:42:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>, <Thread(tpool_thread_0, started daemon 132223357408960)>, <Thread(tpool_thread_1, started daemon 132223349016256)>, <Thread(tpool_thread_2, started daemon 132223340623552)>, <Thread(tpool_thread_3, started daemon 132223332230848)>, <Thread(tpool_thread_4, started daemon 132223323838144)>, <Thread(tpool_thread_5, started daemon 132223315445440)>, <Thread(tpool_thread_6, started daemon 132223307052736)>, <Thread(tpool_thread_7, started daemon 132223298660032)>, <Thread(tpool_thread_8, started daemon 132223290250944)>, <Thread(tpool_thread_9, started daemon 132223281841856)>, <Thread(tpool_thread_10, started daemon 132223273432768)>, <Thread(tpool_thread_11, started daemon 132223265023680)>, <Thread(tpool_thread_12, started daemon 132223256614592)>, <Thread(tpool_thread_13, started daemon 132223248205504)>, <Thread(tpool_thread_14, started daemon 132223239796416)>, <Thread(tpool_thread_15, started daemon 132223231387328)>, <Thread(tpool_thread_16, started daemon 132223222978240)>, <Thread(tpool_thread_17, started daemon 132223214569152)>, <Thread(tpool_thread_18, started daemon 132223206160064)>, <Thread(tpool_thread_19, started daemon 132223197750976)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:42:00 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cbb79418-8b1e-4e3a-93de-7393901b48a3 1073741824" returned: 0 in 0.650s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cbb79418-8b1e-4e3a-93de-7393901b48a3 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:00 devstack sudo[98484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cbb79418-8b1e-4e3a-93de-7393901b48a3
Nov 05 09:42:00 devstack sudo[98484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:01 devstack sudo[98484]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cbb79418-8b1e-4e3a-93de-7393901b48a3" returned: 0 in 0.339s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:42:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:42:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.592s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:42:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-961073315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a96769e-1f54-4cb3-a018-cf15709f3bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383a8e15ad054f108734c6c6830873f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:41:57Z,use_quota=True,user_id='9a3b47f156df4d87ad30a3da2f88b49a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:42:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] Creating volume 9a96769e-1f54-4cb3-a018-cf15709f3bb6 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:42:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:42:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:42:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:42:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:42:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:42:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:42:01 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:42:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9a96769e-1f54-4cb3-a018-cf15709f3bb6 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (536e765f-f586-49aa-8b2b-56efb12d46f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbb79418-8b1e-4e3a-93de-7393901b48a3', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:42:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76a933c5-34d8-44ae-86b4-cf7b264693a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:42:01 devstack sudo[98487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9a96769e-1f54-4cb3-a018-cf15709f3bb6 1073741824
Nov 05 09:42:01 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:01 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] Volume volume-cbb79418-8b1e-4e3a-93de-7393901b48a3 (cbb79418-8b1e-4e3a-93de-7393901b48a3): created successfully
Nov 05 09:42:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76a933c5-34d8-44ae-86b4-cf7b264693a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:42:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] Flow 'volume_create_manager' (c1046f6a-711e-4749-933a-34ee76e93a80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:42:01 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-9d86a77e-7a38-462f-81d3-ac8f01423a94 tempest-CreateVolumesFromImageTest-1847404906 None] Created volume successfully.
Nov 05 09:42:01 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9a96769e-1f54-4cb3-a018-cf15709f3bb6 1073741824" returned: 0 in 0.561s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9a96769e-1f54-4cb3-a018-cf15709f3bb6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:01 devstack sudo[98493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9a96769e-1f54-4cb3-a018-cf15709f3bb6
Nov 05 09:42:01 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:02 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9a96769e-1f54-4cb3-a018-cf15709f3bb6" returned: 0 in 0.346s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:42:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:42:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.913s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:42:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1667433605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f890f05-ed03-49a9-816d-5cf32dae2fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383a8e15ad054f108734c6c6830873f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:41:58Z,use_quota=True,user_id='9a3b47f156df4d87ad30a3da2f88b49a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:42:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] Creating volume 4f890f05-ed03-49a9-816d-5cf32dae2fb6 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:42:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:42:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:42:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:42:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:42:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:42:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:42:02 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:42:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-4f890f05-ed03-49a9-816d-5cf32dae2fb6 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb4e5bf8-6cc2-401e-9cd5-06d8cf285042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a96769e-1f54-4cb3-a018-cf15709f3bb6', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:42:02 devstack sudo[98497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-4f890f05-ed03-49a9-816d-5cf32dae2fb6 1073741824
Nov 05 09:42:02 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a444acfc-bd51-4fbb-a155-74ed181f2b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:42:02 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] Volume volume-9a96769e-1f54-4cb3-a018-cf15709f3bb6 (9a96769e-1f54-4cb3-a018-cf15709f3bb6): created successfully
Nov 05 09:42:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a444acfc-bd51-4fbb-a155-74ed181f2b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:42:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] Flow 'volume_create_manager' (80e3e96c-6c1c-4876-8ec0-f2436b1b9235) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:42:02 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-af402355-19e1-42c1-aacb-fa0ddf5a8ca1 tempest-CreateVolumesFromImageTest-1847404906 None] Created volume successfully.
Nov 05 09:42:02 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-4f890f05-ed03-49a9-816d-5cf32dae2fb6 1073741824" returned: 0 in 0.522s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-4f890f05-ed03-49a9-816d-5cf32dae2fb6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:02 devstack sudo[98504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-4f890f05-ed03-49a9-816d-5cf32dae2fb6
Nov 05 09:42:02 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:03 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-4f890f05-ed03-49a9-816d-5cf32dae2fb6" returned: 0 in 0.355s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:42:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:42:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.274s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:42:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-81906073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8146549-f876-4caf-a56d-265d85a73461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383a8e15ad054f108734c6c6830873f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:41:59Z,use_quota=True,user_id='9a3b47f156df4d87ad30a3da2f88b49a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:42:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] Creating volume d8146549-f876-4caf-a56d-265d85a73461 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:42:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:42:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:42:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:42:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:42:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:42:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:42:03 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:42:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d8146549-f876-4caf-a56d-265d85a73461 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa96b00-a9ac-43ad-b8c5-9852a9b15eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f890f05-ed03-49a9-816d-5cf32dae2fb6', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:42:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e657612-004b-47fe-a302-a8db484d16a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:42:03 devstack sudo[98507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d8146549-f876-4caf-a56d-265d85a73461 1073741824
Nov 05 09:42:03 devstack sudo[98507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:03 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] Volume volume-4f890f05-ed03-49a9-816d-5cf32dae2fb6 (4f890f05-ed03-49a9-816d-5cf32dae2fb6): created successfully
Nov 05 09:42:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e657612-004b-47fe-a302-a8db484d16a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:42:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] Flow 'volume_create_manager' (a968ac51-e5d8-4816-bae8-ab035e355f8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:42:03 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-6084126e-dafd-4fd8-a913-26398be4e8fa tempest-CreateVolumesFromImageTest-1847404906 None] Created volume successfully.
Nov 05 09:42:03 devstack sudo[98507]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d8146549-f876-4caf-a56d-265d85a73461 1073741824" returned: 0 in 0.473s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d8146549-f876-4caf-a56d-265d85a73461 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:03 devstack sudo[98512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d8146549-f876-4caf-a56d-265d85a73461
Nov 05 09:42:03 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:03 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d8146549-f876-4caf-a56d-265d85a73461" returned: 0 in 0.282s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:42:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:42:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a1c3b775-11bf-41ad-89aa-2700179ab390 tempest-VolumesSnapshotListTestJSON-1153668159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.068s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:42:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e6700e-9914-434e-bd24-83a4f5341b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8146549-f876-4caf-a56d-265d85a73461', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:42:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a79394-a0c3-4e3f-b31a-0e03642524e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:42:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-a1c3b775-11bf-41ad-89aa-2700179ab390 tempest-VolumesSnapshotListTestJSON-1153668159 None] Creating offline snapshot 0ecf60d5-5d0f-4bef-8f37-e29610346a97 of volume ee7478b5-2b2d-4529-99fa-4e684bc05c35 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 09:42:04 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] Volume volume-d8146549-f876-4caf-a56d-265d85a73461 (d8146549-f876-4caf-a56d-265d85a73461): created successfully
Nov 05 09:42:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a79394-a0c3-4e3f-b31a-0e03642524e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:42:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] Flow 'volume_create_manager' (fdcf01c8-6f08-414a-b869-e725133c30a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:42:04 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9b3bdf-011f-4674-a6b3-43eb2b977019]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:42:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a1c3b775-11bf-41ad-89aa-2700179ab390 tempest-VolumesSnapshotListTestJSON-1153668159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.a0f15d50-d03d-4dd6-82e3-d41829ca9862 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:04 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-1a1b5f08-34c2-4d58-8909-cac97761fd45 tempest-CreateVolumesFromImageTest-1847404906 None] Created volume successfully.
Nov 05 09:42:04 devstack sudo[98515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.a0f15d50-d03d-4dd6-82e3-d41829ca9862
Nov 05 09:42:04 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-779e8b43-7dfa-46ce-af70-2e46e689a027 tempest-CreateVolumesFromImageTest-1847404906 None] Acquiring lock "cinder-d8146549-f876-4caf-a56d-265d85a73461-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:42:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-779e8b43-7dfa-46ce-af70-2e46e689a027 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "cinder-d8146549-f876-4caf-a56d-265d85a73461-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:42:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-779e8b43-7dfa-46ce-af70-2e46e689a027 tempest-CreateVolumesFromImageTest-1847404906 None] Acquiring lock "cinder-quobyte-d8146549-f876-4caf-a56d-265d85a73461" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:42:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-779e8b43-7dfa-46ce-af70-2e46e689a027 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "cinder-quobyte-d8146549-f876-4caf-a56d-265d85a73461" acquired by "delete_volume" :: waited 0.030s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:42:04 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a949d8-7675-431d-a4bb-77343d6e0e63]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:42:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-779e8b43-7dfa-46ce-af70-2e46e689a027 tempest-CreateVolumesFromImageTest-1847404906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d8146549-f876-4caf-a56d-265d85a73461 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:04 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a1c3b775-11bf-41ad-89aa-2700179ab390 tempest-VolumesSnapshotListTestJSON-1153668159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.a0f15d50-d03d-4dd6-82e3-d41829ca9862" returned: 0 in 0.456s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-a1c3b775-11bf-41ad-89aa-2700179ab390 tempest-VolumesSnapshotListTestJSON-1153668159 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:42:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a1c3b775-11bf-41ad-89aa-2700179ab390 tempest-VolumesSnapshotListTestJSON-1153668159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.a0f15d50-d03d-4dd6-82e3-d41829ca9862,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.0ecf60d5-5d0f-4bef-8f37-e29610346a97 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:04 devstack sudo[98522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.a0f15d50-d03d-4dd6-82e3-d41829ca9862,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.0ecf60d5-5d0f-4bef-8f37-e29610346a97 1G
Nov 05 09:42:04 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:04 devstack sudo[98521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d8146549-f876-4caf-a56d-265d85a73461
Nov 05 09:42:04 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:04 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-779e8b43-7dfa-46ce-af70-2e46e689a027 tempest-CreateVolumesFromImageTest-1847404906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d8146549-f876-4caf-a56d-265d85a73461" returned: 0 in 0.403s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-779e8b43-7dfa-46ce-af70-2e46e689a027 tempest-CreateVolumesFromImageTest-1847404906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d8146549-f876-4caf-a56d-265d85a73461 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:04 devstack sudo[98531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d8146549-f876-4caf-a56d-265d85a73461
Nov 05 09:42:04 devstack sudo[98531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:05 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a1c3b775-11bf-41ad-89aa-2700179ab390 tempest-VolumesSnapshotListTestJSON-1153668159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.a0f15d50-d03d-4dd6-82e3-d41829ca9862,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.0ecf60d5-5d0f-4bef-8f37-e29610346a97 1G" returned: 0 in 0.484s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a1c3b775-11bf-41ad-89aa-2700179ab390 tempest-VolumesSnapshotListTestJSON-1153668159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.a0f15d50-d03d-4dd6-82e3-d41829ca9862 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.0ecf60d5-5d0f-4bef-8f37-e29610346a97 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:05 devstack sudo[98533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.a0f15d50-d03d-4dd6-82e3-d41829ca9862 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.0ecf60d5-5d0f-4bef-8f37-e29610346a97
Nov 05 09:42:05 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:05 devstack sudo[98531]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-779e8b43-7dfa-46ce-af70-2e46e689a027 tempest-CreateVolumesFromImageTest-1847404906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d8146549-f876-4caf-a56d-265d85a73461" returned: 0 in 0.295s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-779e8b43-7dfa-46ce-af70-2e46e689a027 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "cinder-quobyte-d8146549-f876-4caf-a56d-265d85a73461" released by "delete_volume" :: held 0.750s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:42:05 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-779e8b43-7dfa-46ce-af70-2e46e689a027 tempest-CreateVolumesFromImageTest-1847404906 None] Created reservations ['4b408ab7-7341-4131-890c-cad266f504a0', '6abde204-9794-407a-8def-f353eeed862a', 'a4aaeacf-fcc4-41fa-9bd3-24e2c2f1e82b', '7c87ce4f-2a0d-40d0-9f09-6b2853544540'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:42:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-779e8b43-7dfa-46ce-af70-2e46e689a027 tempest-CreateVolumesFromImageTest-1847404906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:42:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-779e8b43-7dfa-46ce-af70-2e46e689a027 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:42:05 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-779e8b43-7dfa-46ce-af70-2e46e689a027 tempest-CreateVolumesFromImageTest-1847404906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:42:05 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-779e8b43-7dfa-46ce-af70-2e46e689a027 tempest-CreateVolumesFromImageTest-1847404906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:42:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-779e8b43-7dfa-46ce-af70-2e46e689a027 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:42:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-779e8b43-7dfa-46ce-af70-2e46e689a027 tempest-CreateVolumesFromImageTest-1847404906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:05 devstack sudo[98540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:42:05 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:05 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a1c3b775-11bf-41ad-89aa-2700179ab390 tempest-VolumesSnapshotListTestJSON-1153668159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.a0f15d50-d03d-4dd6-82e3-d41829ca9862 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.0ecf60d5-5d0f-4bef-8f37-e29610346a97" returned: 0 in 0.477s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:05 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-a1c3b775-11bf-41ad-89aa-2700179ab390 tempest-VolumesSnapshotListTestJSON-1153668159 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.0ecf60d5-5d0f-4bef-8f37-e29610346a97 is being set with open permissions: ugo+rw
Nov 05 09:42:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a1c3b775-11bf-41ad-89aa-2700179ab390 tempest-VolumesSnapshotListTestJSON-1153668159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.0ecf60d5-5d0f-4bef-8f37-e29610346a97 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:05 devstack sudo[98543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.0ecf60d5-5d0f-4bef-8f37-e29610346a97
Nov 05 09:42:05 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b7f4e2f2-f37c-4458-b3c5-bca5912beff0 tempest-CreateVolumesFromImageTest-1847404906 None] Acquiring lock "cinder-4f890f05-ed03-49a9-816d-5cf32dae2fb6-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:42:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b7f4e2f2-f37c-4458-b3c5-bca5912beff0 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "cinder-4f890f05-ed03-49a9-816d-5cf32dae2fb6-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:42:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b7f4e2f2-f37c-4458-b3c5-bca5912beff0 tempest-CreateVolumesFromImageTest-1847404906 None] Acquiring lock "cinder-quobyte-4f890f05-ed03-49a9-816d-5cf32dae2fb6" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:42:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b7f4e2f2-f37c-4458-b3c5-bca5912beff0 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "cinder-quobyte-4f890f05-ed03-49a9-816d-5cf32dae2fb6" acquired by "delete_volume" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:42:05 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efa380d-68dc-4b8b-b1b1-86dbad88c683]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:42:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b7f4e2f2-f37c-4458-b3c5-bca5912beff0 tempest-CreateVolumesFromImageTest-1847404906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-4f890f05-ed03-49a9-816d-5cf32dae2fb6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:05 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-779e8b43-7dfa-46ce-af70-2e46e689a027 tempest-CreateVolumesFromImageTest-1847404906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.526s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:05 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-779e8b43-7dfa-46ce-af70-2e46e689a027 tempest-CreateVolumesFromImageTest-1847404906 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:42:05 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-779e8b43-7dfa-46ce-af70-2e46e689a027 tempest-CreateVolumesFromImageTest-1847404906 None] Deleted volume successfully.
Nov 05 09:42:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-779e8b43-7dfa-46ce-af70-2e46e689a027 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "cinder-d8146549-f876-4caf-a56d-265d85a73461-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:42:06 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a1c3b775-11bf-41ad-89aa-2700179ab390 tempest-VolumesSnapshotListTestJSON-1153668159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.0ecf60d5-5d0f-4bef-8f37-e29610346a97" returned: 0 in 0.494s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a1c3b775-11bf-41ad-89aa-2700179ab390 tempest-VolumesSnapshotListTestJSON-1153668159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.109s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:42:06 devstack sudo[98550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-4f890f05-ed03-49a9-816d-5cf32dae2fb6
Nov 05 09:42:06 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:06 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-a1c3b775-11bf-41ad-89aa-2700179ab390 tempest-VolumesSnapshotListTestJSON-1153668159 None] Create snapshot completed successfully
Nov 05 09:42:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-926e2900-6731-4aa0-b0c1-94c0cdd8f2cc tempest-VolumesSnapshotListTestJSON-1153668159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:42:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-926e2900-6731-4aa0-b0c1-94c0cdd8f2cc tempest-VolumesSnapshotListTestJSON-1153668159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:42:06 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-926e2900-6731-4aa0-b0c1-94c0cdd8f2cc tempest-VolumesSnapshotListTestJSON-1153668159 None] Creating offline snapshot 2af86833-0ff0-4dda-acfb-b5773dd703ca of volume ee7478b5-2b2d-4529-99fa-4e684bc05c35 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 09:42:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b7f4e2f2-f37c-4458-b3c5-bca5912beff0 tempest-CreateVolumesFromImageTest-1847404906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-4f890f05-ed03-49a9-816d-5cf32dae2fb6" returned: 0 in 0.619s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b7f4e2f2-f37c-4458-b3c5-bca5912beff0 tempest-CreateVolumesFromImageTest-1847404906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-4f890f05-ed03-49a9-816d-5cf32dae2fb6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:06 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a382ff-5ce8-412b-83c0-4247ca005830]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:42:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-926e2900-6731-4aa0-b0c1-94c0cdd8f2cc tempest-VolumesSnapshotListTestJSON-1153668159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.0ecf60d5-5d0f-4bef-8f37-e29610346a97 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:06 devstack sudo[98558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-4f890f05-ed03-49a9-816d-5cf32dae2fb6
Nov 05 09:42:06 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:06 devstack sudo[98559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.0ecf60d5-5d0f-4bef-8f37-e29610346a97
Nov 05 09:42:06 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:06 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b7f4e2f2-f37c-4458-b3c5-bca5912beff0 tempest-CreateVolumesFromImageTest-1847404906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-4f890f05-ed03-49a9-816d-5cf32dae2fb6" returned: 0 in 0.289s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b7f4e2f2-f37c-4458-b3c5-bca5912beff0 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "cinder-quobyte-4f890f05-ed03-49a9-816d-5cf32dae2fb6" released by "delete_volume" :: held 0.979s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:42:06 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-b7f4e2f2-f37c-4458-b3c5-bca5912beff0 tempest-CreateVolumesFromImageTest-1847404906 None] Created reservations ['d7fb1c21-7982-4407-8574-86115157108b', 'ff990f72-6bc7-4856-a744-9de75a731220', 'a4b75995-3c4a-4386-8ba1-eceef416bec8', '0291791a-220f-46b4-816d-094edf3cbf64'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:42:07 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-926e2900-6731-4aa0-b0c1-94c0cdd8f2cc tempest-VolumesSnapshotListTestJSON-1153668159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.0ecf60d5-5d0f-4bef-8f37-e29610346a97" returned: 0 in 0.467s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:07 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-926e2900-6731-4aa0-b0c1-94c0cdd8f2cc tempest-VolumesSnapshotListTestJSON-1153668159 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:42:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-926e2900-6731-4aa0-b0c1-94c0cdd8f2cc tempest-VolumesSnapshotListTestJSON-1153668159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.0ecf60d5-5d0f-4bef-8f37-e29610346a97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.2af86833-0ff0-4dda-acfb-b5773dd703ca 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:07 devstack sudo[98571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.0ecf60d5-5d0f-4bef-8f37-e29610346a97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.2af86833-0ff0-4dda-acfb-b5773dd703ca 1G
Nov 05 09:42:07 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b7f4e2f2-f37c-4458-b3c5-bca5912beff0 tempest-CreateVolumesFromImageTest-1847404906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:42:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b7f4e2f2-f37c-4458-b3c5-bca5912beff0 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:42:07 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b7f4e2f2-f37c-4458-b3c5-bca5912beff0 tempest-CreateVolumesFromImageTest-1847404906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:42:07 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b7f4e2f2-f37c-4458-b3c5-bca5912beff0 tempest-CreateVolumesFromImageTest-1847404906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:42:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b7f4e2f2-f37c-4458-b3c5-bca5912beff0 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:42:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b7f4e2f2-f37c-4458-b3c5-bca5912beff0 tempest-CreateVolumesFromImageTest-1847404906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:07 devstack sudo[98573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:42:07 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:07 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b7f4e2f2-f37c-4458-b3c5-bca5912beff0 tempest-CreateVolumesFromImageTest-1847404906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.272s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:07 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-b7f4e2f2-f37c-4458-b3c5-bca5912beff0 tempest-CreateVolumesFromImageTest-1847404906 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:42:07 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b7f4e2f2-f37c-4458-b3c5-bca5912beff0 tempest-CreateVolumesFromImageTest-1847404906 None] Deleted volume successfully.
Nov 05 09:42:07 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b7f4e2f2-f37c-4458-b3c5-bca5912beff0 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "cinder-4f890f05-ed03-49a9-816d-5cf32dae2fb6-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:42:07 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-926e2900-6731-4aa0-b0c1-94c0cdd8f2cc tempest-VolumesSnapshotListTestJSON-1153668159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.0ecf60d5-5d0f-4bef-8f37-e29610346a97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.2af86833-0ff0-4dda-acfb-b5773dd703ca 1G" returned: 0 in 0.521s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-926e2900-6731-4aa0-b0c1-94c0cdd8f2cc tempest-VolumesSnapshotListTestJSON-1153668159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.0ecf60d5-5d0f-4bef-8f37-e29610346a97 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.2af86833-0ff0-4dda-acfb-b5773dd703ca {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:07 devstack sudo[98580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.0ecf60d5-5d0f-4bef-8f37-e29610346a97 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.2af86833-0ff0-4dda-acfb-b5773dd703ca
Nov 05 09:42:07 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:07 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-926e2900-6731-4aa0-b0c1-94c0cdd8f2cc tempest-VolumesSnapshotListTestJSON-1153668159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.0ecf60d5-5d0f-4bef-8f37-e29610346a97 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.2af86833-0ff0-4dda-acfb-b5773dd703ca" returned: 0 in 0.295s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:07 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-926e2900-6731-4aa0-b0c1-94c0cdd8f2cc tempest-VolumesSnapshotListTestJSON-1153668159 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.2af86833-0ff0-4dda-acfb-b5773dd703ca is being set with open permissions: ugo+rw
Nov 05 09:42:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-926e2900-6731-4aa0-b0c1-94c0cdd8f2cc tempest-VolumesSnapshotListTestJSON-1153668159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.2af86833-0ff0-4dda-acfb-b5773dd703ca {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:07 devstack sudo[98585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.2af86833-0ff0-4dda-acfb-b5773dd703ca
Nov 05 09:42:07 devstack sudo[98585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-33f1e546-e99e-46f1-98bb-eef108fe65f7 tempest-CreateVolumesFromImageTest-1847404906 None] Acquiring lock "cinder-9a96769e-1f54-4cb3-a018-cf15709f3bb6-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:42:08 devstack sudo[98585]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-926e2900-6731-4aa0-b0c1-94c0cdd8f2cc tempest-VolumesSnapshotListTestJSON-1153668159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.2af86833-0ff0-4dda-acfb-b5773dd703ca" returned: 0 in 0.260s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-33f1e546-e99e-46f1-98bb-eef108fe65f7 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "cinder-9a96769e-1f54-4cb3-a018-cf15709f3bb6-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:42:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-926e2900-6731-4aa0-b0c1-94c0cdd8f2cc tempest-VolumesSnapshotListTestJSON-1153668159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.669s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:42:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-33f1e546-e99e-46f1-98bb-eef108fe65f7 tempest-CreateVolumesFromImageTest-1847404906 None] Acquiring lock "cinder-quobyte-9a96769e-1f54-4cb3-a018-cf15709f3bb6" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:42:08 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-926e2900-6731-4aa0-b0c1-94c0cdd8f2cc tempest-VolumesSnapshotListTestJSON-1153668159 None] Create snapshot completed successfully
Nov 05 09:42:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-33f1e546-e99e-46f1-98bb-eef108fe65f7 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "cinder-quobyte-9a96769e-1f54-4cb3-a018-cf15709f3bb6" acquired by "delete_volume" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:42:08 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b0bc8c-60dd-4766-8f01-fd25066e032b]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:42:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-33f1e546-e99e-46f1-98bb-eef108fe65f7 tempest-CreateVolumesFromImageTest-1847404906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9a96769e-1f54-4cb3-a018-cf15709f3bb6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:08 devstack sudo[98588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9a96769e-1f54-4cb3-a018-cf15709f3bb6
Nov 05 09:42:08 devstack sudo[98588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:08 devstack sudo[98588]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-33f1e546-e99e-46f1-98bb-eef108fe65f7 tempest-CreateVolumesFromImageTest-1847404906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9a96769e-1f54-4cb3-a018-cf15709f3bb6" returned: 0 in 0.431s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-33f1e546-e99e-46f1-98bb-eef108fe65f7 tempest-CreateVolumesFromImageTest-1847404906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9a96769e-1f54-4cb3-a018-cf15709f3bb6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:08 devstack sudo[98594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9a96769e-1f54-4cb3-a018-cf15709f3bb6
Nov 05 09:42:08 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:08 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-33f1e546-e99e-46f1-98bb-eef108fe65f7 tempest-CreateVolumesFromImageTest-1847404906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9a96769e-1f54-4cb3-a018-cf15709f3bb6" returned: 0 in 0.302s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-33f1e546-e99e-46f1-98bb-eef108fe65f7 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "cinder-quobyte-9a96769e-1f54-4cb3-a018-cf15709f3bb6" released by "delete_volume" :: held 0.796s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:42:09 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-33f1e546-e99e-46f1-98bb-eef108fe65f7 tempest-CreateVolumesFromImageTest-1847404906 None] Created reservations ['9fe2f6cc-bb24-48a7-933d-2e44a61a6d2f', '63db5356-c4e1-4672-9b21-c31059ebca71', '16f7f395-f028-4552-bb01-e4b835be061b', '0fb2154e-7d5f-4786-b39b-6f59fdaf6d66'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:42:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-33f1e546-e99e-46f1-98bb-eef108fe65f7 tempest-CreateVolumesFromImageTest-1847404906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:42:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-33f1e546-e99e-46f1-98bb-eef108fe65f7 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:42:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-33f1e546-e99e-46f1-98bb-eef108fe65f7 tempest-CreateVolumesFromImageTest-1847404906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:42:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-33f1e546-e99e-46f1-98bb-eef108fe65f7 tempest-CreateVolumesFromImageTest-1847404906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:42:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-33f1e546-e99e-46f1-98bb-eef108fe65f7 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:42:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-33f1e546-e99e-46f1-98bb-eef108fe65f7 tempest-CreateVolumesFromImageTest-1847404906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:09 devstack sudo[98598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:42:09 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-534fb3c1-a268-438c-9687-fb4469fb2f92 tempest-CreateVolumesFromImageTest-1847404906 None] Acquiring lock "cinder-cbb79418-8b1e-4e3a-93de-7393901b48a3-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:42:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-534fb3c1-a268-438c-9687-fb4469fb2f92 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "cinder-cbb79418-8b1e-4e3a-93de-7393901b48a3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:42:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-534fb3c1-a268-438c-9687-fb4469fb2f92 tempest-CreateVolumesFromImageTest-1847404906 None] Acquiring lock "cinder-quobyte-cbb79418-8b1e-4e3a-93de-7393901b48a3" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:42:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-534fb3c1-a268-438c-9687-fb4469fb2f92 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "cinder-quobyte-cbb79418-8b1e-4e3a-93de-7393901b48a3" acquired by "delete_volume" :: waited 0.041s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:42:09 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[e113226b-1aee-4021-9ae7-e7d2434e2e6b]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:42:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-534fb3c1-a268-438c-9687-fb4469fb2f92 tempest-CreateVolumesFromImageTest-1847404906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cbb79418-8b1e-4e3a-93de-7393901b48a3 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:09 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-33f1e546-e99e-46f1-98bb-eef108fe65f7 tempest-CreateVolumesFromImageTest-1847404906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.443s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:09 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-33f1e546-e99e-46f1-98bb-eef108fe65f7 tempest-CreateVolumesFromImageTest-1847404906 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:42:09 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-33f1e546-e99e-46f1-98bb-eef108fe65f7 tempest-CreateVolumesFromImageTest-1847404906 None] Deleted volume successfully.
Nov 05 09:42:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-33f1e546-e99e-46f1-98bb-eef108fe65f7 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "cinder-9a96769e-1f54-4cb3-a018-cf15709f3bb6-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:42:09 devstack sudo[98601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cbb79418-8b1e-4e3a-93de-7393901b48a3
Nov 05 09:42:09 devstack sudo[98601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cbd0a347-8ccd-4ab1-979e-d71751e74172 tempest-VolumesSnapshotListTestJSON-1153668159 None] Acquiring lock "cinder-2af86833-0ff0-4dda-acfb-b5773dd703ca-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:42:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cbd0a347-8ccd-4ab1-979e-d71751e74172 tempest-VolumesSnapshotListTestJSON-1153668159 None] Lock "cinder-2af86833-0ff0-4dda-acfb-b5773dd703ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:42:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cbd0a347-8ccd-4ab1-979e-d71751e74172 tempest-VolumesSnapshotListTestJSON-1153668159 None] Acquiring lock "cinder-quobyte-ee7478b5-2b2d-4529-99fa-4e684bc05c35" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:42:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cbd0a347-8ccd-4ab1-979e-d71751e74172 tempest-VolumesSnapshotListTestJSON-1153668159 None] Lock "cinder-quobyte-ee7478b5-2b2d-4529-99fa-4e684bc05c35" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:42:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cbd0a347-8ccd-4ab1-979e-d71751e74172 tempest-VolumesSnapshotListTestJSON-1153668159 None] Acquiring lock "cinder-quobyte-2af86833-0ff0-4dda-acfb-b5773dd703ca" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:42:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cbd0a347-8ccd-4ab1-979e-d71751e74172 tempest-VolumesSnapshotListTestJSON-1153668159 None] Lock "cinder-quobyte-2af86833-0ff0-4dda-acfb-b5773dd703ca" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:42:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-cbd0a347-8ccd-4ab1-979e-d71751e74172 tempest-VolumesSnapshotListTestJSON-1153668159 None] Deleting offline snapshot 2af86833-0ff0-4dda-acfb-b5773dd703ca of volume ee7478b5-2b2d-4529-99fa-4e684bc05c35 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 09:42:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-cbd0a347-8ccd-4ab1-979e-d71751e74172 tempest-VolumesSnapshotListTestJSON-1153668159 None] snapshot_file for this snap is: volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.2af86833-0ff0-4dda-acfb-b5773dd703ca {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 09:42:09 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[c638dc70-0b94-41e8-99c7-8759f08fcdfb]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:42:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cbd0a347-8ccd-4ab1-979e-d71751e74172 tempest-VolumesSnapshotListTestJSON-1153668159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.2af86833-0ff0-4dda-acfb-b5773dd703ca {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:10 devstack sudo[98603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.2af86833-0ff0-4dda-acfb-b5773dd703ca
Nov 05 09:42:10 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:10 devstack sudo[98601]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-534fb3c1-a268-438c-9687-fb4469fb2f92 tempest-CreateVolumesFromImageTest-1847404906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cbb79418-8b1e-4e3a-93de-7393901b48a3" returned: 0 in 0.568s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-534fb3c1-a268-438c-9687-fb4469fb2f92 tempest-CreateVolumesFromImageTest-1847404906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cbb79418-8b1e-4e3a-93de-7393901b48a3 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:10 devstack sudo[98608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cbb79418-8b1e-4e3a-93de-7393901b48a3
Nov 05 09:42:10 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:10 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cbd0a347-8ccd-4ab1-979e-d71751e74172 tempest-VolumesSnapshotListTestJSON-1153668159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.2af86833-0ff0-4dda-acfb-b5773dd703ca" returned: 0 in 0.410s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-cbd0a347-8ccd-4ab1-979e-d71751e74172 tempest-VolumesSnapshotListTestJSON-1153668159 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:42:10 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5036ae4-23a9-47e9-9270-162a1974925f]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:42:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cbd0a347-8ccd-4ab1-979e-d71751e74172 tempest-VolumesSnapshotListTestJSON-1153668159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.0ecf60d5-5d0f-4bef-8f37-e29610346a97 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:10 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-534fb3c1-a268-438c-9687-fb4469fb2f92 tempest-CreateVolumesFromImageTest-1847404906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cbb79418-8b1e-4e3a-93de-7393901b48a3" returned: 0 in 0.279s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-534fb3c1-a268-438c-9687-fb4469fb2f92 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "cinder-quobyte-cbb79418-8b1e-4e3a-93de-7393901b48a3" released by "delete_volume" :: held 0.934s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:42:10 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-534fb3c1-a268-438c-9687-fb4469fb2f92 tempest-CreateVolumesFromImageTest-1847404906 None] Created reservations ['b3eb570f-54eb-4fce-a3a4-7dc2639c69ce', 'd77c4dc9-f9b1-4ee2-a6ed-338b8f3efd36', '8c4aa745-cfb5-4f90-9d3d-7f551f932ab8', '5cd5ddc7-91b8-47ca-b60c-cb49aab1aab6'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:42:10 devstack sudo[98614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.0ecf60d5-5d0f-4bef-8f37-e29610346a97
Nov 05 09:42:10 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-534fb3c1-a268-438c-9687-fb4469fb2f92 tempest-CreateVolumesFromImageTest-1847404906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:42:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-534fb3c1-a268-438c-9687-fb4469fb2f92 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:42:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-534fb3c1-a268-438c-9687-fb4469fb2f92 tempest-CreateVolumesFromImageTest-1847404906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:42:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-534fb3c1-a268-438c-9687-fb4469fb2f92 tempest-CreateVolumesFromImageTest-1847404906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:42:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-534fb3c1-a268-438c-9687-fb4469fb2f92 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:42:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-534fb3c1-a268-438c-9687-fb4469fb2f92 tempest-CreateVolumesFromImageTest-1847404906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:10 devstack sudo[98616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:42:10 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:10 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cbd0a347-8ccd-4ab1-979e-d71751e74172 tempest-VolumesSnapshotListTestJSON-1153668159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.0ecf60d5-5d0f-4bef-8f37-e29610346a97" returned: 0 in 0.384s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-cbd0a347-8ccd-4ab1-979e-d71751e74172 tempest-VolumesSnapshotListTestJSON-1153668159 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:42:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cbd0a347-8ccd-4ab1-979e-d71751e74172 tempest-VolumesSnapshotListTestJSON-1153668159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.2af86833-0ff0-4dda-acfb-b5773dd703ca {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:10 devstack sudo[98622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.2af86833-0ff0-4dda-acfb-b5773dd703ca
Nov 05 09:42:10 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:10 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-534fb3c1-a268-438c-9687-fb4469fb2f92 tempest-CreateVolumesFromImageTest-1847404906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.289s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:10 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-534fb3c1-a268-438c-9687-fb4469fb2f92 tempest-CreateVolumesFromImageTest-1847404906 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:42:10 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-534fb3c1-a268-438c-9687-fb4469fb2f92 tempest-CreateVolumesFromImageTest-1847404906 None] Deleted volume successfully.
Nov 05 09:42:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-534fb3c1-a268-438c-9687-fb4469fb2f92 tempest-CreateVolumesFromImageTest-1847404906 None] Lock "cinder-cbb79418-8b1e-4e3a-93de-7393901b48a3-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:42:11 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cbd0a347-8ccd-4ab1-979e-d71751e74172 tempest-VolumesSnapshotListTestJSON-1153668159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.2af86833-0ff0-4dda-acfb-b5773dd703ca" returned: 0 in 0.472s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cbd0a347-8ccd-4ab1-979e-d71751e74172 tempest-VolumesSnapshotListTestJSON-1153668159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.2af86833-0ff0-4dda-acfb-b5773dd703ca {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:11 devstack sudo[98629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.2af86833-0ff0-4dda-acfb-b5773dd703ca
Nov 05 09:42:11 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:11 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cbd0a347-8ccd-4ab1-979e-d71751e74172 tempest-VolumesSnapshotListTestJSON-1153668159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.2af86833-0ff0-4dda-acfb-b5773dd703ca" returned: 0 in 0.261s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cbd0a347-8ccd-4ab1-979e-d71751e74172 tempest-VolumesSnapshotListTestJSON-1153668159 None] Lock "cinder-quobyte-2af86833-0ff0-4dda-acfb-b5773dd703ca" released by "_delete_snapshot" :: held 1.637s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:42:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cbd0a347-8ccd-4ab1-979e-d71751e74172 tempest-VolumesSnapshotListTestJSON-1153668159 None] Lock "cinder-quobyte-ee7478b5-2b2d-4529-99fa-4e684bc05c35" released by "delete_snapshot" :: held 1.680s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:42:11 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-cbd0a347-8ccd-4ab1-979e-d71751e74172 tempest-VolumesSnapshotListTestJSON-1153668159 None] Created reservations ['3d32ec1f-5f02-49df-a1bd-41d2e6a387b8', 'ca70e3d5-2571-4ac7-b7d4-3a91ec86491d', '4aa39178-7560-4c9d-a98e-bdb11fe0ddf4', '6572ca4e-bcfb-4e10-b779-1cdd43cb7d87'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:42:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-008a08dc-c005-4ee1-b5a2-dc486e369adc tempest-CreateVolumesFromImageTest-1847404906 None] Acquiring lock "cinder-cdeeac4b-f817-4314-bb5c-7e8be7e6241e-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:42:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-008a08dc-c005-4ee1-b5a2-dc486e369adc tempest-CreateVolumesFromImageTest-1847404906 None] Lock "cinder-cdeeac4b-f817-4314-bb5c-7e8be7e6241e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:42:11 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-cbd0a347-8ccd-4ab1-979e-d71751e74172 tempest-VolumesSnapshotListTestJSON-1153668159 None] Delete snapshot completed successfully.
Nov 05 09:42:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-008a08dc-c005-4ee1-b5a2-dc486e369adc tempest-CreateVolumesFromImageTest-1847404906 None] Acquiring lock "cinder-quobyte-cdeeac4b-f817-4314-bb5c-7e8be7e6241e" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:42:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cbd0a347-8ccd-4ab1-979e-d71751e74172 tempest-VolumesSnapshotListTestJSON-1153668159 None] Lock "cinder-2af86833-0ff0-4dda-acfb-b5773dd703ca-delete_snapshot" released by "delete_snapshot" :: held 1.932s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:42:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-008a08dc-c005-4ee1-b5a2-dc486e369adc tempest-CreateVolumesFromImageTest-1847404906 None] Lock "cinder-quobyte-cdeeac4b-f817-4314-bb5c-7e8be7e6241e" acquired by "delete_volume" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:42:11 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84412fb-e91f-4cee-bfe6-e5021641bdb5]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:42:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-008a08dc-c005-4ee1-b5a2-dc486e369adc tempest-CreateVolumesFromImageTest-1847404906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cdeeac4b-f817-4314-bb5c-7e8be7e6241e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:11 devstack sudo[98632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cdeeac4b-f817-4314-bb5c-7e8be7e6241e
Nov 05 09:42:11 devstack sudo[98632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7d0c4d69-6826-4157-a110-8504984f2b2c tempest-VolumesSnapshotListTestJSON-1153668159 None] Acquiring lock "cinder-0ecf60d5-5d0f-4bef-8f37-e29610346a97-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:42:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7d0c4d69-6826-4157-a110-8504984f2b2c tempest-VolumesSnapshotListTestJSON-1153668159 None] Lock "cinder-0ecf60d5-5d0f-4bef-8f37-e29610346a97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:42:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7d0c4d69-6826-4157-a110-8504984f2b2c tempest-VolumesSnapshotListTestJSON-1153668159 None] Acquiring lock "cinder-quobyte-ee7478b5-2b2d-4529-99fa-4e684bc05c35" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:42:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7d0c4d69-6826-4157-a110-8504984f2b2c tempest-VolumesSnapshotListTestJSON-1153668159 None] Lock "cinder-quobyte-ee7478b5-2b2d-4529-99fa-4e684bc05c35" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:42:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7d0c4d69-6826-4157-a110-8504984f2b2c tempest-VolumesSnapshotListTestJSON-1153668159 None] Acquiring lock "cinder-quobyte-0ecf60d5-5d0f-4bef-8f37-e29610346a97" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:42:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7d0c4d69-6826-4157-a110-8504984f2b2c tempest-VolumesSnapshotListTestJSON-1153668159 None] Lock "cinder-quobyte-0ecf60d5-5d0f-4bef-8f37-e29610346a97" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:42:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-7d0c4d69-6826-4157-a110-8504984f2b2c tempest-VolumesSnapshotListTestJSON-1153668159 None] Deleting offline snapshot 0ecf60d5-5d0f-4bef-8f37-e29610346a97 of volume ee7478b5-2b2d-4529-99fa-4e684bc05c35 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 09:42:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-7d0c4d69-6826-4157-a110-8504984f2b2c tempest-VolumesSnapshotListTestJSON-1153668159 None] snapshot_file for this snap is: volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.0ecf60d5-5d0f-4bef-8f37-e29610346a97 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 09:42:12 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51c5259-dad3-42e8-8229-c2ebc23952bc]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:42:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d0c4d69-6826-4157-a110-8504984f2b2c tempest-VolumesSnapshotListTestJSON-1153668159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.0ecf60d5-5d0f-4bef-8f37-e29610346a97 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:12 devstack sudo[98632]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-008a08dc-c005-4ee1-b5a2-dc486e369adc tempest-CreateVolumesFromImageTest-1847404906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cdeeac4b-f817-4314-bb5c-7e8be7e6241e" returned: 0 in 0.480s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-008a08dc-c005-4ee1-b5a2-dc486e369adc tempest-CreateVolumesFromImageTest-1847404906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cdeeac4b-f817-4314-bb5c-7e8be7e6241e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:12 devstack sudo[98638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cdeeac4b-f817-4314-bb5c-7e8be7e6241e
Nov 05 09:42:12 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:12 devstack sudo[98637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.0ecf60d5-5d0f-4bef-8f37-e29610346a97
Nov 05 09:42:12 devstack sudo[98637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:12 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-008a08dc-c005-4ee1-b5a2-dc486e369adc tempest-CreateVolumesFromImageTest-1847404906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cdeeac4b-f817-4314-bb5c-7e8be7e6241e" returned: 0 in 0.300s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-008a08dc-c005-4ee1-b5a2-dc486e369adc tempest-CreateVolumesFromImageTest-1847404906 None] Lock "cinder-quobyte-cdeeac4b-f817-4314-bb5c-7e8be7e6241e" released by "delete_volume" :: held 0.824s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:42:12 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-008a08dc-c005-4ee1-b5a2-dc486e369adc tempest-CreateVolumesFromImageTest-1847404906 None] Created reservations ['18ee3a76-0bd4-4301-9aab-be9f3b1de56f', 'a3863ba4-6bb9-4e08-9340-e971e3104aae', '63bebb00-3b1b-4988-bde0-21d82b6e5e19', '6762fc72-1af1-45e4-b749-7bb22bc2e47a'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:42:12 devstack sudo[98637]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d0c4d69-6826-4157-a110-8504984f2b2c tempest-VolumesSnapshotListTestJSON-1153668159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.0ecf60d5-5d0f-4bef-8f37-e29610346a97" returned: 0 in 0.496s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-7d0c4d69-6826-4157-a110-8504984f2b2c tempest-VolumesSnapshotListTestJSON-1153668159 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:42:12 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd645b8-19d6-435d-8d5e-38ebcb068bcf]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:42:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d0c4d69-6826-4157-a110-8504984f2b2c tempest-VolumesSnapshotListTestJSON-1153668159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.a0f15d50-d03d-4dd6-82e3-d41829ca9862 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-008a08dc-c005-4ee1-b5a2-dc486e369adc tempest-CreateVolumesFromImageTest-1847404906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:42:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-008a08dc-c005-4ee1-b5a2-dc486e369adc tempest-CreateVolumesFromImageTest-1847404906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:42:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-008a08dc-c005-4ee1-b5a2-dc486e369adc tempest-CreateVolumesFromImageTest-1847404906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:42:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-008a08dc-c005-4ee1-b5a2-dc486e369adc tempest-CreateVolumesFromImageTest-1847404906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:42:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-008a08dc-c005-4ee1-b5a2-dc486e369adc tempest-CreateVolumesFromImageTest-1847404906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:42:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-008a08dc-c005-4ee1-b5a2-dc486e369adc tempest-CreateVolumesFromImageTest-1847404906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:12 devstack sudo[98652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:42:12 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:12 devstack sudo[98651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.a0f15d50-d03d-4dd6-82e3-d41829ca9862
Nov 05 09:42:12 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:13 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-008a08dc-c005-4ee1-b5a2-dc486e369adc tempest-CreateVolumesFromImageTest-1847404906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.341s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:13 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-008a08dc-c005-4ee1-b5a2-dc486e369adc tempest-CreateVolumesFromImageTest-1847404906 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:42:13 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-008a08dc-c005-4ee1-b5a2-dc486e369adc tempest-CreateVolumesFromImageTest-1847404906 None] Deleted volume successfully.
Nov 05 09:42:13 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-008a08dc-c005-4ee1-b5a2-dc486e369adc tempest-CreateVolumesFromImageTest-1847404906 None] Lock "cinder-cdeeac4b-f817-4314-bb5c-7e8be7e6241e-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:42:13 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d0c4d69-6826-4157-a110-8504984f2b2c tempest-VolumesSnapshotListTestJSON-1153668159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.a0f15d50-d03d-4dd6-82e3-d41829ca9862" returned: 0 in 0.546s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-7d0c4d69-6826-4157-a110-8504984f2b2c tempest-VolumesSnapshotListTestJSON-1153668159 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:42:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d0c4d69-6826-4157-a110-8504984f2b2c tempest-VolumesSnapshotListTestJSON-1153668159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.0ecf60d5-5d0f-4bef-8f37-e29610346a97 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:13 devstack sudo[98660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.0ecf60d5-5d0f-4bef-8f37-e29610346a97
Nov 05 09:42:13 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:13 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d0c4d69-6826-4157-a110-8504984f2b2c tempest-VolumesSnapshotListTestJSON-1153668159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.0ecf60d5-5d0f-4bef-8f37-e29610346a97" returned: 0 in 0.606s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d0c4d69-6826-4157-a110-8504984f2b2c tempest-VolumesSnapshotListTestJSON-1153668159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.0ecf60d5-5d0f-4bef-8f37-e29610346a97 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:13 devstack sudo[98666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.0ecf60d5-5d0f-4bef-8f37-e29610346a97
Nov 05 09:42:13 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:14 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d0c4d69-6826-4157-a110-8504984f2b2c tempest-VolumesSnapshotListTestJSON-1153668159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.0ecf60d5-5d0f-4bef-8f37-e29610346a97" returned: 0 in 0.356s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:14 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7d0c4d69-6826-4157-a110-8504984f2b2c tempest-VolumesSnapshotListTestJSON-1153668159 None] Lock "cinder-quobyte-0ecf60d5-5d0f-4bef-8f37-e29610346a97" released by "_delete_snapshot" :: held 2.180s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:42:14 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7d0c4d69-6826-4157-a110-8504984f2b2c tempest-VolumesSnapshotListTestJSON-1153668159 None] Lock "cinder-quobyte-ee7478b5-2b2d-4529-99fa-4e684bc05c35" released by "delete_snapshot" :: held 2.209s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:42:14 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-7d0c4d69-6826-4157-a110-8504984f2b2c tempest-VolumesSnapshotListTestJSON-1153668159 None] Created reservations ['c1d92497-7f61-4e89-82da-c0c8ea54897d', 'd412a6f9-d1db-465c-b0b4-684a1f388c81', 'bb383389-c0cc-430c-a82d-30b8eb868547', '954c5a72-0466-429c-b95c-364878ff0363'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:42:14 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-7d0c4d69-6826-4157-a110-8504984f2b2c tempest-VolumesSnapshotListTestJSON-1153668159 None] Delete snapshot completed successfully.
Nov 05 09:42:14 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7d0c4d69-6826-4157-a110-8504984f2b2c tempest-VolumesSnapshotListTestJSON-1153668159 None] Lock "cinder-0ecf60d5-5d0f-4bef-8f37-e29610346a97-delete_snapshot" released by "delete_snapshot" :: held 2.421s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:42:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8c1a0b5c-adc4-4736-bd4b-e9a4124721d6 tempest-VolumesSnapshotListTestJSON-1153668159 None] Acquiring lock "cinder-a0f15d50-d03d-4dd6-82e3-d41829ca9862-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:42:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8c1a0b5c-adc4-4736-bd4b-e9a4124721d6 tempest-VolumesSnapshotListTestJSON-1153668159 None] Lock "cinder-a0f15d50-d03d-4dd6-82e3-d41829ca9862-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:42:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8c1a0b5c-adc4-4736-bd4b-e9a4124721d6 tempest-VolumesSnapshotListTestJSON-1153668159 None] Acquiring lock "cinder-quobyte-ee7478b5-2b2d-4529-99fa-4e684bc05c35" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:42:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8c1a0b5c-adc4-4736-bd4b-e9a4124721d6 tempest-VolumesSnapshotListTestJSON-1153668159 None] Lock "cinder-quobyte-ee7478b5-2b2d-4529-99fa-4e684bc05c35" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:42:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8c1a0b5c-adc4-4736-bd4b-e9a4124721d6 tempest-VolumesSnapshotListTestJSON-1153668159 None] Acquiring lock "cinder-quobyte-a0f15d50-d03d-4dd6-82e3-d41829ca9862" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:42:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8c1a0b5c-adc4-4736-bd4b-e9a4124721d6 tempest-VolumesSnapshotListTestJSON-1153668159 None] Lock "cinder-quobyte-a0f15d50-d03d-4dd6-82e3-d41829ca9862" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:42:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-8c1a0b5c-adc4-4736-bd4b-e9a4124721d6 tempest-VolumesSnapshotListTestJSON-1153668159 None] Deleting offline snapshot a0f15d50-d03d-4dd6-82e3-d41829ca9862 of volume ee7478b5-2b2d-4529-99fa-4e684bc05c35 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 09:42:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-8c1a0b5c-adc4-4736-bd4b-e9a4124721d6 tempest-VolumesSnapshotListTestJSON-1153668159 None] snapshot_file for this snap is: volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.a0f15d50-d03d-4dd6-82e3-d41829ca9862 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 09:42:15 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d4d024-c079-420a-a8e3-0cdb603e44b3]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:42:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c1a0b5c-adc4-4736-bd4b-e9a4124721d6 tempest-VolumesSnapshotListTestJSON-1153668159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.a0f15d50-d03d-4dd6-82e3-d41829ca9862 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:15 devstack sudo[98699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.a0f15d50-d03d-4dd6-82e3-d41829ca9862
Nov 05 09:42:15 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:15 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c1a0b5c-adc4-4736-bd4b-e9a4124721d6 tempest-VolumesSnapshotListTestJSON-1153668159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.a0f15d50-d03d-4dd6-82e3-d41829ca9862" returned: 0 in 0.463s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-8c1a0b5c-adc4-4736-bd4b-e9a4124721d6 tempest-VolumesSnapshotListTestJSON-1153668159 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:42:15 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5739e78-4c07-4d9b-86ab-1ee1f7928ceb]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:42:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c1a0b5c-adc4-4736-bd4b-e9a4124721d6 tempest-VolumesSnapshotListTestJSON-1153668159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:16 devstack sudo[98705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35
Nov 05 09:42:16 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:16 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c1a0b5c-adc4-4736-bd4b-e9a4124721d6 tempest-VolumesSnapshotListTestJSON-1153668159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35" returned: 0 in 0.431s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c1a0b5c-adc4-4736-bd4b-e9a4124721d6 tempest-VolumesSnapshotListTestJSON-1153668159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.a0f15d50-d03d-4dd6-82e3-d41829ca9862 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:16 devstack sudo[98710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.a0f15d50-d03d-4dd6-82e3-d41829ca9862
Nov 05 09:42:16 devstack sudo[98710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:16 devstack sudo[98710]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c1a0b5c-adc4-4736-bd4b-e9a4124721d6 tempest-VolumesSnapshotListTestJSON-1153668159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.a0f15d50-d03d-4dd6-82e3-d41829ca9862" returned: 0 in 0.361s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c1a0b5c-adc4-4736-bd4b-e9a4124721d6 tempest-VolumesSnapshotListTestJSON-1153668159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.a0f15d50-d03d-4dd6-82e3-d41829ca9862 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:16 devstack sudo[98716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.a0f15d50-d03d-4dd6-82e3-d41829ca9862
Nov 05 09:42:16 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:17 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8c1a0b5c-adc4-4736-bd4b-e9a4124721d6 tempest-VolumesSnapshotListTestJSON-1153668159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35.a0f15d50-d03d-4dd6-82e3-d41829ca9862" returned: 0 in 0.287s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8c1a0b5c-adc4-4736-bd4b-e9a4124721d6 tempest-VolumesSnapshotListTestJSON-1153668159 None] Lock "cinder-quobyte-a0f15d50-d03d-4dd6-82e3-d41829ca9862" released by "_delete_snapshot" :: held 1.687s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:42:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8c1a0b5c-adc4-4736-bd4b-e9a4124721d6 tempest-VolumesSnapshotListTestJSON-1153668159 None] Lock "cinder-quobyte-ee7478b5-2b2d-4529-99fa-4e684bc05c35" released by "delete_snapshot" :: held 1.714s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:42:17 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-8c1a0b5c-adc4-4736-bd4b-e9a4124721d6 tempest-VolumesSnapshotListTestJSON-1153668159 None] Created reservations ['bfb2f04e-ef4c-41e3-a343-6396baf5ec67', '3ff3dcc9-00fd-4ac9-949d-a2b23084775a', '6fe53d9e-bdd9-4549-bbc0-ce8621414e8f', '5467c205-5cbf-480d-82e5-bb5b32185f87'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:42:17 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-8c1a0b5c-adc4-4736-bd4b-e9a4124721d6 tempest-VolumesSnapshotListTestJSON-1153668159 None] Delete snapshot completed successfully.
Nov 05 09:42:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8c1a0b5c-adc4-4736-bd4b-e9a4124721d6 tempest-VolumesSnapshotListTestJSON-1153668159 None] Lock "cinder-a0f15d50-d03d-4dd6-82e3-d41829ca9862-delete_snapshot" released by "delete_snapshot" :: held 1.897s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:42:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3e743918-8918-4605-9ddb-ff677a7c068a tempest-VolumesSnapshotListTestJSON-1153668159 None] Acquiring lock "cinder-ee7478b5-2b2d-4529-99fa-4e684bc05c35-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:42:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3e743918-8918-4605-9ddb-ff677a7c068a tempest-VolumesSnapshotListTestJSON-1153668159 None] Lock "cinder-ee7478b5-2b2d-4529-99fa-4e684bc05c35-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:42:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3e743918-8918-4605-9ddb-ff677a7c068a tempest-VolumesSnapshotListTestJSON-1153668159 None] Acquiring lock "cinder-quobyte-ee7478b5-2b2d-4529-99fa-4e684bc05c35" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:42:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3e743918-8918-4605-9ddb-ff677a7c068a tempest-VolumesSnapshotListTestJSON-1153668159 None] Lock "cinder-quobyte-ee7478b5-2b2d-4529-99fa-4e684bc05c35" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:42:17 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[912b37e5-36f9-4ccb-baef-fe014e9f5cf1]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:42:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3e743918-8918-4605-9ddb-ff677a7c068a tempest-VolumesSnapshotListTestJSON-1153668159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:17 devstack sudo[98719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35
Nov 05 09:42:17 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:18 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3e743918-8918-4605-9ddb-ff677a7c068a tempest-VolumesSnapshotListTestJSON-1153668159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35" returned: 0 in 0.408s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3e743918-8918-4605-9ddb-ff677a7c068a tempest-VolumesSnapshotListTestJSON-1153668159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:18 devstack sudo[98725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35
Nov 05 09:42:18 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:18 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3e743918-8918-4605-9ddb-ff677a7c068a tempest-VolumesSnapshotListTestJSON-1153668159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ee7478b5-2b2d-4529-99fa-4e684bc05c35" returned: 0 in 0.276s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3e743918-8918-4605-9ddb-ff677a7c068a tempest-VolumesSnapshotListTestJSON-1153668159 None] Lock "cinder-quobyte-ee7478b5-2b2d-4529-99fa-4e684bc05c35" released by "delete_volume" :: held 0.776s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:42:18 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-3e743918-8918-4605-9ddb-ff677a7c068a tempest-VolumesSnapshotListTestJSON-1153668159 None] Created reservations ['48714e45-eaad-43af-82f8-16138c4bde51', '70e7a447-101d-4fff-8df6-a19f6f12d0ba', '96ad50ac-6708-4202-8ffc-4bd8bd67e41c', 'cb5a8626-201c-4c92-8da4-348f71af0a26'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:42:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3e743918-8918-4605-9ddb-ff677a7c068a tempest-VolumesSnapshotListTestJSON-1153668159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:42:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3e743918-8918-4605-9ddb-ff677a7c068a tempest-VolumesSnapshotListTestJSON-1153668159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:42:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3e743918-8918-4605-9ddb-ff677a7c068a tempest-VolumesSnapshotListTestJSON-1153668159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:42:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3e743918-8918-4605-9ddb-ff677a7c068a tempest-VolumesSnapshotListTestJSON-1153668159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:42:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3e743918-8918-4605-9ddb-ff677a7c068a tempest-VolumesSnapshotListTestJSON-1153668159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:42:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3e743918-8918-4605-9ddb-ff677a7c068a tempest-VolumesSnapshotListTestJSON-1153668159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:42:18 devstack sudo[98728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:42:18 devstack sudo[98728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:42:18 devstack sudo[98728]: pam_unix(sudo:session): session closed for user root
Nov 05 09:42:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3e743918-8918-4605-9ddb-ff677a7c068a tempest-VolumesSnapshotListTestJSON-1153668159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.271s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:42:18 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-3e743918-8918-4605-9ddb-ff677a7c068a tempest-VolumesSnapshotListTestJSON-1153668159 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:42:18 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-3e743918-8918-4605-9ddb-ff677a7c068a tempest-VolumesSnapshotListTestJSON-1153668159 None] Deleted volume successfully.
Nov 05 09:42:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3e743918-8918-4605-9ddb-ff677a7c068a tempest-VolumesSnapshotListTestJSON-1153668159 None] Lock "cinder-ee7478b5-2b2d-4529-99fa-4e684bc05c35-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:42:28 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=118,cinder:UPDATE=131,cinder:DELETE=12,cinder:INSERT=29 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:42:28 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=91,cinder:UPDATE=134,cinder:INSERT=46,cinder:DELETE=11 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:42:48 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-170d2bce-55d4-4ca9-bba6-fc663b2aa425 req-74eb4703-5507-4a77-932e-f4bd77827c10 tempest-TestShelveInstance-850736521 None] Terminate volume connection completed successfully.
Nov 05 09:42:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-170d2bce-55d4-4ca9-bba6-fc663b2aa425 req-74eb4703-5507-4a77-932e-f4bd77827c10 tempest-TestShelveInstance-850736521 None] Deleting attachment f52338be-e6a4-4033-a494-7b6ed7078f66. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 09:42:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-13698702-8158-4a7a-b3ab-1eca5ce30cf4 req-d45e577e-5bd9-44f0-a514-ba175c275b4a tempest-TestShelveInstance-850736521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:42:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-13698702-8158-4a7a-b3ab-1eca5ce30cf4 req-d45e577e-5bd9-44f0-a514-ba175c275b4a tempest-TestShelveInstance-850736521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:42:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-13698702-8158-4a7a-b3ab-1eca5ce30cf4 req-d45e577e-5bd9-44f0-a514-ba175c275b4a tempest-TestShelveInstance-850736521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:42:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-13698702-8158-4a7a-b3ab-1eca5ce30cf4 req-d45e577e-5bd9-44f0-a514-ba175c275b4a tempest-TestShelveInstance-850736521 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1', 'name': 'volume-49468252-add1-4f82-b8ae-2a977f9a2cb4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b5c33949-8df8-4f5d-ab82-f5bb0b085d14', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 09:42:52 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-13698702-8158-4a7a-b3ab-1eca5ce30cf4 req-d45e577e-5bd9-44f0-a514-ba175c275b4a tempest-TestShelveInstance-850736521 None] attachment_update completed successfully.
Nov 05 09:43:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:43:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:43:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:43:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:43:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:43:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:43:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:43:00 devstack sudo[99063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:43:00 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:43:00 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root
Nov 05 09:43:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.500s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:43:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:43:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:43:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 28 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:43:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>, <Thread(tpool_thread_0, started daemon 132223357408960)>, <Thread(tpool_thread_1, started daemon 132223349016256)>, <Thread(tpool_thread_2, started daemon 132223340623552)>, <Thread(tpool_thread_3, started daemon 132223332230848)>, <Thread(tpool_thread_4, started daemon 132223323838144)>, <Thread(tpool_thread_5, started daemon 132223315445440)>, <Thread(tpool_thread_6, started daemon 132223307052736)>, <Thread(tpool_thread_7, started daemon 132223298660032)>, <Thread(tpool_thread_8, started daemon 132223290250944)>, <Thread(tpool_thread_9, started daemon 132223281841856)>, <Thread(tpool_thread_10, started daemon 132223273432768)>, <Thread(tpool_thread_11, started daemon 132223265023680)>, <Thread(tpool_thread_12, started daemon 132223256614592)>, <Thread(tpool_thread_13, started daemon 132223248205504)>, <Thread(tpool_thread_14, started daemon 132223239796416)>, <Thread(tpool_thread_15, started daemon 132223231387328)>, <Thread(tpool_thread_16, started daemon 132223222978240)>, <Thread(tpool_thread_17, started daemon 132223214569152)>, <Thread(tpool_thread_18, started daemon 132223206160064)>, <Thread(tpool_thread_19, started daemon 132223197750976)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:43:06 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:43:06 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:43:08 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:43:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] Flow 'volume_create_manager' (6587434a-3754-4672-a136-bcee2e7683f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:43:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c6565c-7f7a-4dfe-b3f5-842b429701d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:43:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c6565c-7f7a-4dfe-b3f5-842b429701d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-145279577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73f0cd72-2628-4c76-a33b-de892bdae370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9dd377701b24dfd86e50aec41b14624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:43:08Z,use_quota=True,user_id='3fb1f8e99bd8470098a4b21a6f845a89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:43:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccf1b98c-83ad-4679-a736-5388606dd38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:43:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccf1b98c-83ad-4679-a736-5388606dd38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:43:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f668d53e-45d3-488d-ba05-e0941cf969b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:43:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f668d53e-45d3-488d-ba05-e0941cf969b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73f0cd72-2628-4c76-a33b-de892bdae370', 'volume_name': 'volume-73f0cd72-2628-4c76-a33b-de892bdae370', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:43:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caa09f08-ad0d-403d-ac2e-68bc652b9d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:43:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caa09f08-ad0d-403d-ac2e-68bc652b9d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:43:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf59c2e-6978-4ac7-81bd-f04e7c04cd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:43:08 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] Volume 73f0cd72-2628-4c76-a33b-de892bdae370: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73f0cd72-2628-4c76-a33b-de892bdae370', 'volume_size': 1}
Nov 05 09:43:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:43:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:43:08 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-145279577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73f0cd72-2628-4c76-a33b-de892bdae370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9dd377701b24dfd86e50aec41b14624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:43:08Z,use_quota=True,user_id='3fb1f8e99bd8470098a4b21a6f845a89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:43:08 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] Creating volume 73f0cd72-2628-4c76-a33b-de892bdae370 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:43:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:43:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:43:08 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:43:08 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:43:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:43:08 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:43:08 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:43:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-73f0cd72-2628-4c76-a33b-de892bdae370 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:43:08 devstack sudo[99452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-73f0cd72-2628-4c76-a33b-de892bdae370 1073741824
Nov 05 09:43:08 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:43:08 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root
Nov 05 09:43:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-73f0cd72-2628-4c76-a33b-de892bdae370 1073741824" returned: 0 in 0.755s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:43:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-73f0cd72-2628-4c76-a33b-de892bdae370 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:43:09 devstack sudo[99461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-73f0cd72-2628-4c76-a33b-de892bdae370
Nov 05 09:43:09 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:43:09 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root
Nov 05 09:43:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-73f0cd72-2628-4c76-a33b-de892bdae370" returned: 0 in 0.564s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:43:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:43:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:43:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf59c2e-6978-4ac7-81bd-f04e7c04cd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73f0cd72-2628-4c76-a33b-de892bdae370', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:43:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27448838-e2e7-42e2-8871-d9789fe892ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:43:09 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] Volume volume-73f0cd72-2628-4c76-a33b-de892bdae370 (73f0cd72-2628-4c76-a33b-de892bdae370): created successfully
Nov 05 09:43:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27448838-e2e7-42e2-8871-d9789fe892ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:43:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] Flow 'volume_create_manager' (6587434a-3754-4672-a136-bcee2e7683f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:43:09 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ef6a0a3c-c4c5-4388-a4db-1964373bf1ca tempest-TestMinimumBasicScenario-181498870 None] Created volume successfully.
Nov 05 09:43:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-1d487ab5-d8c9-4be6-8bf3-a61d1592abd6 req-88a17e6e-058b-4270-8746-28160454d3e8 tempest-TestMinimumBasicScenario-181498870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:43:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-1d487ab5-d8c9-4be6-8bf3-a61d1592abd6 req-88a17e6e-058b-4270-8746-28160454d3e8 tempest-TestMinimumBasicScenario-181498870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:43:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-1d487ab5-d8c9-4be6-8bf3-a61d1592abd6 req-88a17e6e-058b-4270-8746-28160454d3e8 tempest-TestMinimumBasicScenario-181498870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:43:11 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-1d487ab5-d8c9-4be6-8bf3-a61d1592abd6 req-88a17e6e-058b-4270-8746-28160454d3e8 tempest-TestMinimumBasicScenario-181498870 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1', 'name': 'volume-73f0cd72-2628-4c76-a33b-de892bdae370', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'adbcc2ef-d209-49eb-9447-5bbbbb1eccb2', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 09:43:12 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-1d487ab5-d8c9-4be6-8bf3-a61d1592abd6 req-88a17e6e-058b-4270-8746-28160454d3e8 tempest-TestMinimumBasicScenario-181498870 None] attachment_update completed successfully.
Nov 05 09:43:21 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10,cinder:DELETE=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:43:21 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=5 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:43:43 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:43:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] Flow 'volume_create_manager' (6914d795-6e18-4cc2-ac2c-9a44faf1c8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:43:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9869dc6-ce9d-418a-b6ac-1e6717d52fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:43:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9869dc6-ce9d-418a-b6ac-1e6717d52fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1164754523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dffd6030-f879-43d9-bc66-9002608119a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9299aca46e4a58b81b80790ba6a4d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:43:43Z,use_quota=True,user_id='59015f6858dd499b93837a2aef5a5b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:43:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b33467-45d1-4914-b949-75b78a5eb1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:43:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b33467-45d1-4914-b949-75b78a5eb1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:43:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228023a7-4997-4372-a4a8-5cb70b048120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:43:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228023a7-4997-4372-a4a8-5cb70b048120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dffd6030-f879-43d9-bc66-9002608119a2', 'volume_name': 'volume-dffd6030-f879-43d9-bc66-9002608119a2', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:43:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d72729a-70af-486f-b0ba-decf2a26f61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:43:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d72729a-70af-486f-b0ba-decf2a26f61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:43:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6435252a-c23f-4680-82cc-2bf79e373969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:43:43 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] Volume dffd6030-f879-43d9-bc66-9002608119a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dffd6030-f879-43d9-bc66-9002608119a2', 'volume_size': 1}
Nov 05 09:43:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:43:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:43:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1164754523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dffd6030-f879-43d9-bc66-9002608119a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9299aca46e4a58b81b80790ba6a4d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:43:43Z,use_quota=True,user_id='59015f6858dd499b93837a2aef5a5b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:43:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] Creating volume dffd6030-f879-43d9-bc66-9002608119a2 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:43:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:43:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:43:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:43:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:43:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:43:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:43:43 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:43:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dffd6030-f879-43d9-bc66-9002608119a2 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:43:43 devstack sudo[99756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dffd6030-f879-43d9-bc66-9002608119a2 1073741824
Nov 05 09:43:43 devstack sudo[99756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:43:43 devstack sudo[99756]: pam_unix(sudo:session): session closed for user root
Nov 05 09:43:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dffd6030-f879-43d9-bc66-9002608119a2 1073741824" returned: 0 in 0.561s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:43:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dffd6030-f879-43d9-bc66-9002608119a2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:43:44 devstack sudo[99762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dffd6030-f879-43d9-bc66-9002608119a2
Nov 05 09:43:44 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:43:44 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root
Nov 05 09:43:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dffd6030-f879-43d9-bc66-9002608119a2" returned: 0 in 0.346s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:43:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:43:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:43:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6435252a-c23f-4680-82cc-2bf79e373969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dffd6030-f879-43d9-bc66-9002608119a2', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:43:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971c9e40-d590-43d7-860b-0adc4e688821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:43:44 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] Volume volume-dffd6030-f879-43d9-bc66-9002608119a2 (dffd6030-f879-43d9-bc66-9002608119a2): created successfully
Nov 05 09:43:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971c9e40-d590-43d7-860b-0adc4e688821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:43:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] Flow 'volume_create_manager' (6914d795-6e18-4cc2-ac2c-9a44faf1c8c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:43:44 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-3d020086-9894-47d7-9eaf-85dbd4c95ac3 tempest-AttachVolumeNegativeTest-1674973412 None] Created volume successfully.
Nov 05 09:43:44 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-e278b13d-c5fe-40aa-ab59-e59fcebef045 req-00c01ead-3735-4856-9fb5-273aeb730524 tempest-TestShelveInstance-850736521 None] Terminate volume connection completed successfully.
Nov 05 09:43:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-e278b13d-c5fe-40aa-ab59-e59fcebef045 req-00c01ead-3735-4856-9fb5-273aeb730524 tempest-TestShelveInstance-850736521 None] Deleting attachment b5c33949-8df8-4f5d-ab82-f5bb0b085d14. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 09:43:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-e278b13d-c5fe-40aa-ab59-e59fcebef045 req-9e0bdf18-ddc6-4efc-8d21-69ef15ead175 tempest-TestShelveInstance-850736521 None] Acquiring lock "cinder-49468252-add1-4f82-b8ae-2a977f9a2cb4-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:43:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-e278b13d-c5fe-40aa-ab59-e59fcebef045 req-9e0bdf18-ddc6-4efc-8d21-69ef15ead175 tempest-TestShelveInstance-850736521 None] Lock "cinder-49468252-add1-4f82-b8ae-2a977f9a2cb4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:43:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-e278b13d-c5fe-40aa-ab59-e59fcebef045 req-9e0bdf18-ddc6-4efc-8d21-69ef15ead175 tempest-TestShelveInstance-850736521 None] Acquiring lock "cinder-quobyte-49468252-add1-4f82-b8ae-2a977f9a2cb4" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:43:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-e278b13d-c5fe-40aa-ab59-e59fcebef045 req-9e0bdf18-ddc6-4efc-8d21-69ef15ead175 tempest-TestShelveInstance-850736521 None] Lock "cinder-quobyte-49468252-add1-4f82-b8ae-2a977f9a2cb4" acquired by "delete_volume" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:43:44 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e7edb1-0886-4ccb-b404-a00b7d238a35]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:43:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-e278b13d-c5fe-40aa-ab59-e59fcebef045 req-9e0bdf18-ddc6-4efc-8d21-69ef15ead175 tempest-TestShelveInstance-850736521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49468252-add1-4f82-b8ae-2a977f9a2cb4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:43:45 devstack sudo[99767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49468252-add1-4f82-b8ae-2a977f9a2cb4
Nov 05 09:43:45 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:43:45 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root
Nov 05 09:43:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-e278b13d-c5fe-40aa-ab59-e59fcebef045 req-9e0bdf18-ddc6-4efc-8d21-69ef15ead175 tempest-TestShelveInstance-850736521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49468252-add1-4f82-b8ae-2a977f9a2cb4" returned: 0 in 0.539s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:43:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-e278b13d-c5fe-40aa-ab59-e59fcebef045 req-9e0bdf18-ddc6-4efc-8d21-69ef15ead175 tempest-TestShelveInstance-850736521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49468252-add1-4f82-b8ae-2a977f9a2cb4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:43:45 devstack sudo[99775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49468252-add1-4f82-b8ae-2a977f9a2cb4
Nov 05 09:43:45 devstack sudo[99775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:43:45 devstack sudo[99775]: pam_unix(sudo:session): session closed for user root
Nov 05 09:43:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-e278b13d-c5fe-40aa-ab59-e59fcebef045 req-9e0bdf18-ddc6-4efc-8d21-69ef15ead175 tempest-TestShelveInstance-850736521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-49468252-add1-4f82-b8ae-2a977f9a2cb4" returned: 0 in 0.332s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:43:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-e278b13d-c5fe-40aa-ab59-e59fcebef045 req-9e0bdf18-ddc6-4efc-8d21-69ef15ead175 tempest-TestShelveInstance-850736521 None] Lock "cinder-quobyte-49468252-add1-4f82-b8ae-2a977f9a2cb4" released by "delete_volume" :: held 0.935s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:43:45 devstack cinder-volume[86649]: DEBUG cinder.quota [req-e278b13d-c5fe-40aa-ab59-e59fcebef045 req-9e0bdf18-ddc6-4efc-8d21-69ef15ead175 tempest-TestShelveInstance-850736521 None] Created reservations ['bf5a4fc2-e465-4cf3-80f6-8ce187457a3d', '25bf4425-c5f1-446e-a932-d7a7f38e3b5d', 'c7bf8c06-b11a-4bdf-a69f-f078e98f193a', '160d3a27-aa9a-48cd-9c23-6a39a0f42d5d'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:43:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-e278b13d-c5fe-40aa-ab59-e59fcebef045 req-9e0bdf18-ddc6-4efc-8d21-69ef15ead175 tempest-TestShelveInstance-850736521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:43:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-e278b13d-c5fe-40aa-ab59-e59fcebef045 req-9e0bdf18-ddc6-4efc-8d21-69ef15ead175 tempest-TestShelveInstance-850736521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:43:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [req-e278b13d-c5fe-40aa-ab59-e59fcebef045 req-9e0bdf18-ddc6-4efc-8d21-69ef15ead175 tempest-TestShelveInstance-850736521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:43:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [req-e278b13d-c5fe-40aa-ab59-e59fcebef045 req-9e0bdf18-ddc6-4efc-8d21-69ef15ead175 tempest-TestShelveInstance-850736521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:43:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-e278b13d-c5fe-40aa-ab59-e59fcebef045 req-9e0bdf18-ddc6-4efc-8d21-69ef15ead175 tempest-TestShelveInstance-850736521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:43:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-e278b13d-c5fe-40aa-ab59-e59fcebef045 req-9e0bdf18-ddc6-4efc-8d21-69ef15ead175 tempest-TestShelveInstance-850736521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:43:46 devstack sudo[99786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:43:46 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:43:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-8ca027b2-408a-495f-ae9d-ded77a4afcf4 req-924043b9-a7a5-44e3-a916-0baad5361a9b tempest-AttachVolumeNegativeTest-1674973412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:43:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-8ca027b2-408a-495f-ae9d-ded77a4afcf4 req-924043b9-a7a5-44e3-a916-0baad5361a9b tempest-AttachVolumeNegativeTest-1674973412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:43:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [req-8ca027b2-408a-495f-ae9d-ded77a4afcf4 req-924043b9-a7a5-44e3-a916-0baad5361a9b tempest-AttachVolumeNegativeTest-1674973412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:43:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-8ca027b2-408a-495f-ae9d-ded77a4afcf4 req-924043b9-a7a5-44e3-a916-0baad5361a9b tempest-AttachVolumeNegativeTest-1674973412 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1', 'name': 'volume-dffd6030-f879-43d9-bc66-9002608119a2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2254935b-ab42-418e-97dc-90ed53950398', 'enforce_multipath': True} {{(pid=86649) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 09:43:46 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root
Nov 05 09:43:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [req-e278b13d-c5fe-40aa-ab59-e59fcebef045 req-9e0bdf18-ddc6-4efc-8d21-69ef15ead175 tempest-TestShelveInstance-850736521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.369s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:43:46 devstack cinder-volume[86649]: DEBUG cinder.manager [req-e278b13d-c5fe-40aa-ab59-e59fcebef045 req-9e0bdf18-ddc6-4efc-8d21-69ef15ead175 tempest-TestShelveInstance-850736521 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:43:46 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-e278b13d-c5fe-40aa-ab59-e59fcebef045 req-9e0bdf18-ddc6-4efc-8d21-69ef15ead175 tempest-TestShelveInstance-850736521 None] Deleted volume successfully.
Nov 05 09:43:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [req-e278b13d-c5fe-40aa-ab59-e59fcebef045 req-9e0bdf18-ddc6-4efc-8d21-69ef15ead175 tempest-TestShelveInstance-850736521 None] Lock "cinder-49468252-add1-4f82-b8ae-2a977f9a2cb4-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:43:46 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-8ca027b2-408a-495f-ae9d-ded77a4afcf4 req-924043b9-a7a5-44e3-a916-0baad5361a9b tempest-AttachVolumeNegativeTest-1674973412 None] attachment_update completed successfully.
Nov 05 09:43:49 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-7be6d5ba-c350-42c3-b40c-8537e5e3bcdd req-edbf5943-a6ef-4cbc-b9f7-47a8ebc81996 tempest-AttachVolumeNegativeTest-1674973412 None] Terminate volume connection completed successfully.
Nov 05 09:43:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-7be6d5ba-c350-42c3-b40c-8537e5e3bcdd req-edbf5943-a6ef-4cbc-b9f7-47a8ebc81996 tempest-AttachVolumeNegativeTest-1674973412 None] Deleting attachment 2254935b-ab42-418e-97dc-90ed53950398. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 09:43:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e5049898-351a-4ac9-8cfd-3bc692b2f25d tempest-AttachVolumeNegativeTest-1674973412 None] Acquiring lock "cinder-dffd6030-f879-43d9-bc66-9002608119a2-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:43:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e5049898-351a-4ac9-8cfd-3bc692b2f25d tempest-AttachVolumeNegativeTest-1674973412 None] Lock "cinder-dffd6030-f879-43d9-bc66-9002608119a2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:43:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e5049898-351a-4ac9-8cfd-3bc692b2f25d tempest-AttachVolumeNegativeTest-1674973412 None] Acquiring lock "cinder-quobyte-dffd6030-f879-43d9-bc66-9002608119a2" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:43:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e5049898-351a-4ac9-8cfd-3bc692b2f25d tempest-AttachVolumeNegativeTest-1674973412 None] Lock "cinder-quobyte-dffd6030-f879-43d9-bc66-9002608119a2" acquired by "delete_volume" :: waited 0.031s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:43:57 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcf85df-ca64-4472-9b4f-5c0d14a4527a]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:43:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e5049898-351a-4ac9-8cfd-3bc692b2f25d tempest-AttachVolumeNegativeTest-1674973412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dffd6030-f879-43d9-bc66-9002608119a2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:43:58 devstack sudo[99825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dffd6030-f879-43d9-bc66-9002608119a2
Nov 05 09:43:58 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:43:58 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root
Nov 05 09:43:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e5049898-351a-4ac9-8cfd-3bc692b2f25d tempest-AttachVolumeNegativeTest-1674973412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dffd6030-f879-43d9-bc66-9002608119a2" returned: 0 in 0.496s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:43:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e5049898-351a-4ac9-8cfd-3bc692b2f25d tempest-AttachVolumeNegativeTest-1674973412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dffd6030-f879-43d9-bc66-9002608119a2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:43:58 devstack sudo[99831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dffd6030-f879-43d9-bc66-9002608119a2
Nov 05 09:43:58 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:43:58 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root
Nov 05 09:43:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e5049898-351a-4ac9-8cfd-3bc692b2f25d tempest-AttachVolumeNegativeTest-1674973412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dffd6030-f879-43d9-bc66-9002608119a2" returned: 0 in 0.326s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:43:58 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e5049898-351a-4ac9-8cfd-3bc692b2f25d tempest-AttachVolumeNegativeTest-1674973412 None] Lock "cinder-quobyte-dffd6030-f879-43d9-bc66-9002608119a2" released by "delete_volume" :: held 0.897s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:43:58 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-e5049898-351a-4ac9-8cfd-3bc692b2f25d tempest-AttachVolumeNegativeTest-1674973412 None] Created reservations ['1800fd91-c112-4e7d-a408-fa189d847c54', '7a25f9d5-4c85-4f7c-8c2b-776037be0382', '5edf1bd9-0de9-4b62-9d4f-ae4be4cec153', '05be98c7-0df6-41c9-93bc-4dc82be05b52'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:43:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e5049898-351a-4ac9-8cfd-3bc692b2f25d tempest-AttachVolumeNegativeTest-1674973412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:43:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e5049898-351a-4ac9-8cfd-3bc692b2f25d tempest-AttachVolumeNegativeTest-1674973412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:43:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e5049898-351a-4ac9-8cfd-3bc692b2f25d tempest-AttachVolumeNegativeTest-1674973412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:43:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e5049898-351a-4ac9-8cfd-3bc692b2f25d tempest-AttachVolumeNegativeTest-1674973412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:43:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e5049898-351a-4ac9-8cfd-3bc692b2f25d tempest-AttachVolumeNegativeTest-1674973412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:43:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e5049898-351a-4ac9-8cfd-3bc692b2f25d tempest-AttachVolumeNegativeTest-1674973412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:43:58 devstack sudo[99836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:43:58 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:43:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f9f32b31-8874-4369-84c3-537c0bef130d tempest-AttachVolumeNegativeTest-1674973412 None] Acquiring lock "cinder-e2fc482b-0c7b-420c-8ac2-13b19738006b-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:43:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f9f32b31-8874-4369-84c3-537c0bef130d tempest-AttachVolumeNegativeTest-1674973412 None] Lock "cinder-e2fc482b-0c7b-420c-8ac2-13b19738006b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:43:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f9f32b31-8874-4369-84c3-537c0bef130d tempest-AttachVolumeNegativeTest-1674973412 None] Acquiring lock "cinder-quobyte-e2fc482b-0c7b-420c-8ac2-13b19738006b" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:43:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f9f32b31-8874-4369-84c3-537c0bef130d tempest-AttachVolumeNegativeTest-1674973412 None] Lock "cinder-quobyte-e2fc482b-0c7b-420c-8ac2-13b19738006b" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:43:59 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root
Nov 05 09:43:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e5049898-351a-4ac9-8cfd-3bc692b2f25d tempest-AttachVolumeNegativeTest-1674973412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.404s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:43:59 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-e5049898-351a-4ac9-8cfd-3bc692b2f25d tempest-AttachVolumeNegativeTest-1674973412 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:43:59 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-e5049898-351a-4ac9-8cfd-3bc692b2f25d tempest-AttachVolumeNegativeTest-1674973412 None] Deleted volume successfully.
Nov 05 09:43:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e5049898-351a-4ac9-8cfd-3bc692b2f25d tempest-AttachVolumeNegativeTest-1674973412 None] Lock "cinder-dffd6030-f879-43d9-bc66-9002608119a2-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:43:59 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd95141-96fe-45ad-86a6-bc4b5abbf733]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:43:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f9f32b31-8874-4369-84c3-537c0bef130d tempest-AttachVolumeNegativeTest-1674973412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e2fc482b-0c7b-420c-8ac2-13b19738006b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:43:59 devstack sudo[99842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e2fc482b-0c7b-420c-8ac2-13b19738006b
Nov 05 09:43:59 devstack sudo[99842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:43:59 devstack sudo[99842]: pam_unix(sudo:session): session closed for user root
Nov 05 09:43:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f9f32b31-8874-4369-84c3-537c0bef130d tempest-AttachVolumeNegativeTest-1674973412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e2fc482b-0c7b-420c-8ac2-13b19738006b" returned: 0 in 0.426s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:43:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f9f32b31-8874-4369-84c3-537c0bef130d tempest-AttachVolumeNegativeTest-1674973412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e2fc482b-0c7b-420c-8ac2-13b19738006b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:43:59 devstack sudo[99847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e2fc482b-0c7b-420c-8ac2-13b19738006b
Nov 05 09:43:59 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:00 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f9f32b31-8874-4369-84c3-537c0bef130d tempest-AttachVolumeNegativeTest-1674973412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e2fc482b-0c7b-420c-8ac2-13b19738006b" returned: 0 in 0.267s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:00 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f9f32b31-8874-4369-84c3-537c0bef130d tempest-AttachVolumeNegativeTest-1674973412 None] Lock "cinder-quobyte-e2fc482b-0c7b-420c-8ac2-13b19738006b" released by "delete_volume" :: held 0.785s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:44:00 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-f9f32b31-8874-4369-84c3-537c0bef130d tempest-AttachVolumeNegativeTest-1674973412 None] Created reservations ['8809af5b-7d48-45ed-ac46-73beda0a14f3', '700b0583-0517-44e4-8c05-a087dad2e308', '14b59814-84c4-4dbd-a927-afe2d16db028', 'a58a7292-9645-4aff-9908-ede604044aa3'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:44:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:44:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:44:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:44:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:44:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:44:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:44:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:00 devstack sudo[99851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:44:00 devstack sudo[99851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f9f32b31-8874-4369-84c3-537c0bef130d tempest-AttachVolumeNegativeTest-1674973412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:44:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f9f32b31-8874-4369-84c3-537c0bef130d tempest-AttachVolumeNegativeTest-1674973412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:44:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f9f32b31-8874-4369-84c3-537c0bef130d tempest-AttachVolumeNegativeTest-1674973412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:44:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f9f32b31-8874-4369-84c3-537c0bef130d tempest-AttachVolumeNegativeTest-1674973412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:44:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f9f32b31-8874-4369-84c3-537c0bef130d tempest-AttachVolumeNegativeTest-1674973412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:44:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f9f32b31-8874-4369-84c3-537c0bef130d tempest-AttachVolumeNegativeTest-1674973412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:00 devstack sudo[99853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:44:00 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:00 devstack sudo[99851]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.337s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:44:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:44:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 28 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:44:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>, <Thread(tpool_thread_0, started daemon 132223357408960)>, <Thread(tpool_thread_1, started daemon 132223349016256)>, <Thread(tpool_thread_2, started daemon 132223340623552)>, <Thread(tpool_thread_3, started daemon 132223332230848)>, <Thread(tpool_thread_4, started daemon 132223323838144)>, <Thread(tpool_thread_5, started daemon 132223315445440)>, <Thread(tpool_thread_6, started daemon 132223307052736)>, <Thread(tpool_thread_7, started daemon 132223298660032)>, <Thread(tpool_thread_8, started daemon 132223290250944)>, <Thread(tpool_thread_9, started daemon 132223281841856)>, <Thread(tpool_thread_10, started daemon 132223273432768)>, <Thread(tpool_thread_11, started daemon 132223265023680)>, <Thread(tpool_thread_12, started daemon 132223256614592)>, <Thread(tpool_thread_13, started daemon 132223248205504)>, <Thread(tpool_thread_14, started daemon 132223239796416)>, <Thread(tpool_thread_15, started daemon 132223231387328)>, <Thread(tpool_thread_16, started daemon 132223222978240)>, <Thread(tpool_thread_17, started daemon 132223214569152)>, <Thread(tpool_thread_18, started daemon 132223206160064)>, <Thread(tpool_thread_19, started daemon 132223197750976)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:44:00 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f9f32b31-8874-4369-84c3-537c0bef130d tempest-AttachVolumeNegativeTest-1674973412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.322s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-f9f32b31-8874-4369-84c3-537c0bef130d tempest-AttachVolumeNegativeTest-1674973412 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:44:00 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f9f32b31-8874-4369-84c3-537c0bef130d tempest-AttachVolumeNegativeTest-1674973412 None] Deleted volume successfully.
Nov 05 09:44:00 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f9f32b31-8874-4369-84c3-537c0bef130d tempest-AttachVolumeNegativeTest-1674973412 None] Lock "cinder-e2fc482b-0c7b-420c-8ac2-13b19738006b-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:44:04 devstack cinder-volume[86649]: INFO cinder.volume.manager [req-cdea0591-7040-4bea-98b3-b76d7b066b95 req-5bcce281-8947-4551-93f2-f7781832de83 tempest-TestMinimumBasicScenario-181498870 None] Terminate volume connection completed successfully.
Nov 05 09:44:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [req-cdea0591-7040-4bea-98b3-b76d7b066b95 req-5bcce281-8947-4551-93f2-f7781832de83 tempest-TestMinimumBasicScenario-181498870 None] Deleting attachment adbcc2ef-d209-49eb-9447-5bbbbb1eccb2. {{(pid=86649) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 09:44:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-eaec118f-0046-42d9-9ef4-43c11806078a tempest-TestMinimumBasicScenario-181498870 None] Acquiring lock "cinder-73f0cd72-2628-4c76-a33b-de892bdae370-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:44:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-eaec118f-0046-42d9-9ef4-43c11806078a tempest-TestMinimumBasicScenario-181498870 None] Lock "cinder-73f0cd72-2628-4c76-a33b-de892bdae370-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:44:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-eaec118f-0046-42d9-9ef4-43c11806078a tempest-TestMinimumBasicScenario-181498870 None] Acquiring lock "cinder-quobyte-73f0cd72-2628-4c76-a33b-de892bdae370" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:44:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-eaec118f-0046-42d9-9ef4-43c11806078a tempest-TestMinimumBasicScenario-181498870 None] Lock "cinder-quobyte-73f0cd72-2628-4c76-a33b-de892bdae370" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:44:05 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f68277-5f84-4eeb-a537-7b48eee14bf1]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:44:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eaec118f-0046-42d9-9ef4-43c11806078a tempest-TestMinimumBasicScenario-181498870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-73f0cd72-2628-4c76-a33b-de892bdae370 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:05 devstack sudo[99864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-73f0cd72-2628-4c76-a33b-de892bdae370
Nov 05 09:44:05 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:05 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eaec118f-0046-42d9-9ef4-43c11806078a tempest-TestMinimumBasicScenario-181498870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-73f0cd72-2628-4c76-a33b-de892bdae370" returned: 0 in 0.393s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eaec118f-0046-42d9-9ef4-43c11806078a tempest-TestMinimumBasicScenario-181498870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-73f0cd72-2628-4c76-a33b-de892bdae370 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:05 devstack sudo[99869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-73f0cd72-2628-4c76-a33b-de892bdae370
Nov 05 09:44:05 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:05 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eaec118f-0046-42d9-9ef4-43c11806078a tempest-TestMinimumBasicScenario-181498870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-73f0cd72-2628-4c76-a33b-de892bdae370" returned: 0 in 0.255s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-eaec118f-0046-42d9-9ef4-43c11806078a tempest-TestMinimumBasicScenario-181498870 None] Lock "cinder-quobyte-73f0cd72-2628-4c76-a33b-de892bdae370" released by "delete_volume" :: held 0.691s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:44:05 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-eaec118f-0046-42d9-9ef4-43c11806078a tempest-TestMinimumBasicScenario-181498870 None] Created reservations ['cd8b858d-0a75-4990-b8c9-a4c3b5e15dcb', '12f7faa4-1e31-4289-afe5-f371aeaea88b', 'ccd515f3-3c39-42da-bbd9-61d2d1c011c4', 'fb11864e-7202-4908-aa1c-cadf39c3048b'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:44:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-eaec118f-0046-42d9-9ef4-43c11806078a tempest-TestMinimumBasicScenario-181498870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:44:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-eaec118f-0046-42d9-9ef4-43c11806078a tempest-TestMinimumBasicScenario-181498870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:44:05 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-eaec118f-0046-42d9-9ef4-43c11806078a tempest-TestMinimumBasicScenario-181498870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:44:05 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-eaec118f-0046-42d9-9ef4-43c11806078a tempest-TestMinimumBasicScenario-181498870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:44:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-eaec118f-0046-42d9-9ef4-43c11806078a tempest-TestMinimumBasicScenario-181498870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:44:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eaec118f-0046-42d9-9ef4-43c11806078a tempest-TestMinimumBasicScenario-181498870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:06 devstack sudo[99872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:44:06 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:06 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eaec118f-0046-42d9-9ef4-43c11806078a tempest-TestMinimumBasicScenario-181498870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.289s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:06 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-eaec118f-0046-42d9-9ef4-43c11806078a tempest-TestMinimumBasicScenario-181498870 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:44:06 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-eaec118f-0046-42d9-9ef4-43c11806078a tempest-TestMinimumBasicScenario-181498870 None] Deleted volume successfully.
Nov 05 09:44:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-eaec118f-0046-42d9-9ef4-43c11806078a tempest-TestMinimumBasicScenario-181498870 None] Lock "cinder-73f0cd72-2628-4c76-a33b-de892bdae370-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:44:15 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=33,cinder:UPDATE=36,cinder:DELETE=1,cinder:INSERT=8 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:44:16 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=30,cinder:UPDATE=37,cinder:INSERT=9,cinder:DELETE=4 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:44:16 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ca7d077f-8428-424c-9000-9f1b3295356c tempest-GroupSnapshotsV319Test-1646000957 None] Group tempest-GroupSnapshotsV319Test-Group-1335373449: creating
Nov 05 09:44:16 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ca7d077f-8428-424c-9000-9f1b3295356c tempest-GroupSnapshotsV319Test-1646000957 None] Group tempest-GroupSnapshotsV319Test-Group-1335373449: created successfully
Nov 05 09:44:16 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ca7d077f-8428-424c-9000-9f1b3295356c tempest-GroupSnapshotsV319Test-1646000957 None] Create group completed successfully.
Nov 05 09:44:18 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:44:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] Flow 'volume_create_manager' (3edeec1b-1306-4887-abc9-dbdab7557503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:44:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (586829fb-6f79-4c0d-882e-6ac2396787ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (586829fb-6f79-4c0d-882e-6ac2396787ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1313699096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=158e7c24-2e44-474c-bdf2-e508acb848a5,host='devstack@QuobyteHD#QuobyteHD',id=df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25377d90f2d5489d9f3a80255b8a45f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:44:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:44:18Z,use_quota=True,user_id='cc71f966a2f9438e8b983bf4895fd027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b13f7db-1f5f-42fb-8672-02e2ef50220e),volume_type_id=5b13f7db-1f5f-42fb-8672-02e2ef50220e)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25464c71-69fc-4082-8441-38a68882e926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25464c71-69fc-4082-8441-38a68882e926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d195318-c238-41b0-af0c-16344ce78d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d195318-c238-41b0-af0c-16344ce78d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef', 'volume_name': 'volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af3271c4-00c2-4151-9cec-1bab1702424e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af3271c4-00c2-4151-9cec-1bab1702424e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60fe342b-70d6-4e95-a8d0-7be1ce3db43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:18 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] Volume df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef', 'volume_size': 1}
Nov 05 09:44:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:44:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:44:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=158e7c24-2e44-474c-bdf2-e508acb848a5,created_at=2026-11-05T08:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1313699096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=158e7c24-2e44-474c-bdf2-e508acb848a5,host='devstack@QuobyteHD#QuobyteHD',id=df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25377d90f2d5489d9f3a80255b8a45f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:44:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:44:18Z,use_quota=True,user_id='cc71f966a2f9438e8b983bf4895fd027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b13f7db-1f5f-42fb-8672-02e2ef50220e),volume_type_id=5b13f7db-1f5f-42fb-8672-02e2ef50220e)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:44:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] Creating volume df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:44:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:44:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:44:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:44:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:44:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:44:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:44:18 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:44:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:18 devstack sudo[99902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef 1073741824
Nov 05 09:44:18 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:19 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef 1073741824" returned: 0 in 0.478s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:19 devstack sudo[99908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef
Nov 05 09:44:19 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:19 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef" returned: 0 in 0.293s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:44:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:44:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60fe342b-70d6-4e95-a8d0-7be1ce3db43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca056b03-80d1-4a44-9e4b-f378a48d4046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:19 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] Volume volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef (df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef): created successfully
Nov 05 09:44:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca056b03-80d1-4a44-9e4b-f378a48d4046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] Flow 'volume_create_manager' (3edeec1b-1306-4887-abc9-dbdab7557503) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:44:19 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-70191c5f-9f4d-458f-957d-6ef06a362595 tempest-GroupSnapshotsV319Test-1646000957 None] Created volume successfully.
Nov 05 09:44:19 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-559dae17-f421-4ccf-81f8-22e7ad538e60 tempest-GroupSnapshotsV319Test-1646000957 None] GroupSnapshot e017e121-c6ff-472f-8626-42f23ba81ce9: creating.
Nov 05 09:44:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-559dae17-f421-4ccf-81f8-22e7ad538e60 tempest-GroupSnapshotsV319Test-1646000957 None] Group snapshot e017e121-c6ff-472f-8626-42f23ba81ce9: creating. {{(pid=86649) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 05 09:44:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-559dae17-f421-4ccf-81f8-22e7ad538e60 tempest-GroupSnapshotsV319Test-1646000957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:44:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-559dae17-f421-4ccf-81f8-22e7ad538e60 tempest-GroupSnapshotsV319Test-1646000957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:44:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-559dae17-f421-4ccf-81f8-22e7ad538e60 tempest-GroupSnapshotsV319Test-1646000957 None] Creating offline snapshot eab18e4d-05b1-4a86-a4b2-e37529d74db9 of volume df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 09:44:19 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b79b90d-f802-4cde-a2fd-63d96e4c546c]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:44:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-559dae17-f421-4ccf-81f8-22e7ad538e60 tempest-GroupSnapshotsV319Test-1646000957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:20 devstack sudo[99913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef
Nov 05 09:44:20 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:20 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-559dae17-f421-4ccf-81f8-22e7ad538e60 tempest-GroupSnapshotsV319Test-1646000957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef" returned: 0 in 0.402s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-559dae17-f421-4ccf-81f8-22e7ad538e60 tempest-GroupSnapshotsV319Test-1646000957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef.eab18e4d-05b1-4a86-a4b2-e37529d74db9 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:20 devstack sudo[99919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef.eab18e4d-05b1-4a86-a4b2-e37529d74db9 1G
Nov 05 09:44:20 devstack sudo[99919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:20 devstack sudo[99919]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-559dae17-f421-4ccf-81f8-22e7ad538e60 tempest-GroupSnapshotsV319Test-1646000957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef.eab18e4d-05b1-4a86-a4b2-e37529d74db9 1G" returned: 0 in 0.436s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-559dae17-f421-4ccf-81f8-22e7ad538e60 tempest-GroupSnapshotsV319Test-1646000957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef.eab18e4d-05b1-4a86-a4b2-e37529d74db9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:20 devstack sudo[99925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef.eab18e4d-05b1-4a86-a4b2-e37529d74db9
Nov 05 09:44:20 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:21 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-559dae17-f421-4ccf-81f8-22e7ad538e60 tempest-GroupSnapshotsV319Test-1646000957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef.eab18e4d-05b1-4a86-a4b2-e37529d74db9" returned: 0 in 0.351s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:21 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-559dae17-f421-4ccf-81f8-22e7ad538e60 tempest-GroupSnapshotsV319Test-1646000957 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef.eab18e4d-05b1-4a86-a4b2-e37529d74db9 is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 09:44:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-559dae17-f421-4ccf-81f8-22e7ad538e60 tempest-GroupSnapshotsV319Test-1646000957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef.eab18e4d-05b1-4a86-a4b2-e37529d74db9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:21 devstack sudo[99931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef.eab18e4d-05b1-4a86-a4b2-e37529d74db9
Nov 05 09:44:21 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:21 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-559dae17-f421-4ccf-81f8-22e7ad538e60 tempest-GroupSnapshotsV319Test-1646000957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef.eab18e4d-05b1-4a86-a4b2-e37529d74db9" returned: 0 in 0.272s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-559dae17-f421-4ccf-81f8-22e7ad538e60 tempest-GroupSnapshotsV319Test-1646000957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:21 devstack sudo[99934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef.info
Nov 05 09:44:21 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:21 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-559dae17-f421-4ccf-81f8-22e7ad538e60 tempest-GroupSnapshotsV319Test-1646000957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef.info" returned: 0 in 0.270s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:21 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-559dae17-f421-4ccf-81f8-22e7ad538e60 tempest-GroupSnapshotsV319Test-1646000957 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 09:44:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-559dae17-f421-4ccf-81f8-22e7ad538e60 tempest-GroupSnapshotsV319Test-1646000957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:21 devstack sudo[99937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef.info
Nov 05 09:44:21 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:22 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-559dae17-f421-4ccf-81f8-22e7ad538e60 tempest-GroupSnapshotsV319Test-1646000957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef.info" returned: 0 in 0.267s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-559dae17-f421-4ccf-81f8-22e7ad538e60 tempest-GroupSnapshotsV319Test-1646000957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.105s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:44:22 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-559dae17-f421-4ccf-81f8-22e7ad538e60 tempest-GroupSnapshotsV319Test-1646000957 None] group_snapshot e017e121-c6ff-472f-8626-42f23ba81ce9: created successfully
Nov 05 09:44:23 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-677e491c-a0b1-45d2-9cdc-0d959c1acb10 tempest-GroupSnapshotsV319Test-1646000957 None] group_snapshot e017e121-c6ff-472f-8626-42f23ba81ce9: deleting
Nov 05 09:44:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-677e491c-a0b1-45d2-9cdc-0d959c1acb10 tempest-GroupSnapshotsV319Test-1646000957 None] group_snapshot e017e121-c6ff-472f-8626-42f23ba81ce9: deleting {{(pid=86649) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 05 09:44:23 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-677e491c-a0b1-45d2-9cdc-0d959c1acb10 tempest-GroupSnapshotsV319Test-1646000957 None] Acquiring lock "cinder-quobyte-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:44:23 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-677e491c-a0b1-45d2-9cdc-0d959c1acb10 tempest-GroupSnapshotsV319Test-1646000957 None] Lock "cinder-quobyte-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:44:23 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-677e491c-a0b1-45d2-9cdc-0d959c1acb10 tempest-GroupSnapshotsV319Test-1646000957 None] Acquiring lock "cinder-quobyte-eab18e4d-05b1-4a86-a4b2-e37529d74db9" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:44:23 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-677e491c-a0b1-45d2-9cdc-0d959c1acb10 tempest-GroupSnapshotsV319Test-1646000957 None] Lock "cinder-quobyte-eab18e4d-05b1-4a86-a4b2-e37529d74db9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:44:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-677e491c-a0b1-45d2-9cdc-0d959c1acb10 tempest-GroupSnapshotsV319Test-1646000957 None] Deleting offline snapshot eab18e4d-05b1-4a86-a4b2-e37529d74db9 of volume df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 09:44:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-677e491c-a0b1-45d2-9cdc-0d959c1acb10 tempest-GroupSnapshotsV319Test-1646000957 None] snapshot_file for this snap is: volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef.eab18e4d-05b1-4a86-a4b2-e37529d74db9 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 09:44:23 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[c130e9a1-7937-4f39-97b7-fa4f07fe4585]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:44:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-677e491c-a0b1-45d2-9cdc-0d959c1acb10 tempest-GroupSnapshotsV319Test-1646000957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef.eab18e4d-05b1-4a86-a4b2-e37529d74db9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:23 devstack sudo[99940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef.eab18e4d-05b1-4a86-a4b2-e37529d74db9
Nov 05 09:44:23 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:24 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-677e491c-a0b1-45d2-9cdc-0d959c1acb10 tempest-GroupSnapshotsV319Test-1646000957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef.eab18e4d-05b1-4a86-a4b2-e37529d74db9" returned: 0 in 0.414s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-677e491c-a0b1-45d2-9cdc-0d959c1acb10 tempest-GroupSnapshotsV319Test-1646000957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:44:24 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[199adc28-8f93-426d-9607-771a5534e44d]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:44:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-677e491c-a0b1-45d2-9cdc-0d959c1acb10 tempest-GroupSnapshotsV319Test-1646000957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:24 devstack sudo[99945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef
Nov 05 09:44:24 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:24 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-677e491c-a0b1-45d2-9cdc-0d959c1acb10 tempest-GroupSnapshotsV319Test-1646000957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef" returned: 0 in 0.376s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-677e491c-a0b1-45d2-9cdc-0d959c1acb10 tempest-GroupSnapshotsV319Test-1646000957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef.eab18e4d-05b1-4a86-a4b2-e37529d74db9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:24 devstack sudo[99950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef.eab18e4d-05b1-4a86-a4b2-e37529d74db9
Nov 05 09:44:24 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:25 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-677e491c-a0b1-45d2-9cdc-0d959c1acb10 tempest-GroupSnapshotsV319Test-1646000957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef.eab18e4d-05b1-4a86-a4b2-e37529d74db9" returned: 0 in 0.439s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-677e491c-a0b1-45d2-9cdc-0d959c1acb10 tempest-GroupSnapshotsV319Test-1646000957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef.eab18e4d-05b1-4a86-a4b2-e37529d74db9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:25 devstack sudo[99956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef.eab18e4d-05b1-4a86-a4b2-e37529d74db9
Nov 05 09:44:25 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:25 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-677e491c-a0b1-45d2-9cdc-0d959c1acb10 tempest-GroupSnapshotsV319Test-1646000957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef.eab18e4d-05b1-4a86-a4b2-e37529d74db9" returned: 0 in 0.296s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:25 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-677e491c-a0b1-45d2-9cdc-0d959c1acb10 tempest-GroupSnapshotsV319Test-1646000957 None] Lock "cinder-quobyte-eab18e4d-05b1-4a86-a4b2-e37529d74db9" released by "_delete_snapshot" :: held 1.658s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:44:25 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-677e491c-a0b1-45d2-9cdc-0d959c1acb10 tempest-GroupSnapshotsV319Test-1646000957 None] Lock "cinder-quobyte-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef" released by "delete_snapshot" :: held 1.686s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:44:25 devstack cinder-volume[86649]: WARNING cinder.quota [None req-677e491c-a0b1-45d2-9cdc-0d959c1acb10 tempest-GroupSnapshotsV319Test-1646000957 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-232725203 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-232725203, it is now deprecated. Please use the default quota class for default quota.
Nov 05 09:44:25 devstack cinder-volume[86649]: WARNING cinder.quota [None req-677e491c-a0b1-45d2-9cdc-0d959c1acb10 tempest-GroupSnapshotsV319Test-1646000957 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-232725203 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-232725203, it is now deprecated. Please use the default quota class for default quota.
Nov 05 09:44:25 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-677e491c-a0b1-45d2-9cdc-0d959c1acb10 tempest-GroupSnapshotsV319Test-1646000957 None] Created reservations ['9a9817c0-cedd-4c61-9a16-eab45af1a0a9', 'c5860383-3466-400d-a88d-3630624e72e4', 'c8c630b6-d66b-4ed0-a4a5-7a66f692f148', 'd476fe2a-d605-459b-a933-4beb3ac77078'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:44:25 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-677e491c-a0b1-45d2-9cdc-0d959c1acb10 tempest-GroupSnapshotsV319Test-1646000957 None] group_snapshot e017e121-c6ff-472f-8626-42f23ba81ce9: deleted successfully
Nov 05 09:44:26 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e1b4d81e-35c7-41e8-a126-248c3c2d3821 tempest-GroupSnapshotsV319Test-1646000957 None] Acquiring lock "cinder-quobyte-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:44:26 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e1b4d81e-35c7-41e8-a126-248c3c2d3821 tempest-GroupSnapshotsV319Test-1646000957 None] Lock "cinder-quobyte-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef" acquired by "delete_volume" :: waited 0.026s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:44:26 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5788239-9dd2-445d-acfb-79d1e2b3c97f]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:44:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e1b4d81e-35c7-41e8-a126-248c3c2d3821 tempest-GroupSnapshotsV319Test-1646000957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:26 devstack sudo[99960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef
Nov 05 09:44:26 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:26 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e1b4d81e-35c7-41e8-a126-248c3c2d3821 tempest-GroupSnapshotsV319Test-1646000957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef" returned: 0 in 0.410s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e1b4d81e-35c7-41e8-a126-248c3c2d3821 tempest-GroupSnapshotsV319Test-1646000957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:26 devstack sudo[99965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef
Nov 05 09:44:26 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:27 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e1b4d81e-35c7-41e8-a126-248c3c2d3821 tempest-GroupSnapshotsV319Test-1646000957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef" returned: 0 in 0.272s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e1b4d81e-35c7-41e8-a126-248c3c2d3821 tempest-GroupSnapshotsV319Test-1646000957 None] Lock "cinder-quobyte-df6a6bcc-14f2-4d41-9774-1f1b1ebb02ef" released by "delete_volume" :: held 0.757s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:44:27 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-e1b4d81e-35c7-41e8-a126-248c3c2d3821 tempest-GroupSnapshotsV319Test-1646000957 None] Created reservations ['d233c82d-4d91-4c23-bfc0-bdc798ffbee8'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:44:27 devstack cinder-volume[86649]: WARNING cinder.quota [None req-e1b4d81e-35c7-41e8-a126-248c3c2d3821 tempest-GroupSnapshotsV319Test-1646000957 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-232725203 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-232725203, it is now deprecated. Please use the default quota class for default quota.
Nov 05 09:44:27 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-e1b4d81e-35c7-41e8-a126-248c3c2d3821 tempest-GroupSnapshotsV319Test-1646000957 None] Created reservations ['99979f1a-5459-4d0b-b95c-2e6c462ed4a2', 'd4b2af78-e7ce-4f47-834d-43d0ad79bba5', 'ad8f4dec-0d0a-41f4-9359-4696d3c4b3dd', '27efe385-5ed0-43a8-bf40-2a8eafa135cc'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:44:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e1b4d81e-35c7-41e8-a126-248c3c2d3821 tempest-GroupSnapshotsV319Test-1646000957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:44:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e1b4d81e-35c7-41e8-a126-248c3c2d3821 tempest-GroupSnapshotsV319Test-1646000957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:44:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e1b4d81e-35c7-41e8-a126-248c3c2d3821 tempest-GroupSnapshotsV319Test-1646000957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:44:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e1b4d81e-35c7-41e8-a126-248c3c2d3821 tempest-GroupSnapshotsV319Test-1646000957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:44:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e1b4d81e-35c7-41e8-a126-248c3c2d3821 tempest-GroupSnapshotsV319Test-1646000957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:44:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e1b4d81e-35c7-41e8-a126-248c3c2d3821 tempest-GroupSnapshotsV319Test-1646000957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:27 devstack sudo[99968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:44:27 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:27 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e1b4d81e-35c7-41e8-a126-248c3c2d3821 tempest-GroupSnapshotsV319Test-1646000957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.267s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:27 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-e1b4d81e-35c7-41e8-a126-248c3c2d3821 tempest-GroupSnapshotsV319Test-1646000957 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:44:27 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-e1b4d81e-35c7-41e8-a126-248c3c2d3821 tempest-GroupSnapshotsV319Test-1646000957 None] Delete group completed successfully.
Nov 05 09:44:37 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=21,cinder:UPDATE=25,cinder:INSERT=4 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:44:37 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=28,cinder:UPDATE=21,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:44:46 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:44:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] Flow 'volume_create_manager' (72b0f924-8d99-4549-8209-98df7e62a5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:44:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1decf550-43bc-40ac-b286-1cc0babfeadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1decf550-43bc-40ac-b286-1cc0babfeadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-949148461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c971751a-ac28-46fc-9d9c-f01c7a21a0ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c08c09f1693b40bfb5a39234802acd3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:44:47Z,use_quota=True,user_id='9ff4b322b13b4370ac60487543381cb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2e98674-5e12-4cfc-8922-e321a213ddaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2e98674-5e12-4cfc-8922-e321a213ddaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c369ba-64d5-4d39-878b-ab55f4161317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c369ba-64d5-4d39-878b-ab55f4161317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c971751a-ac28-46fc-9d9c-f01c7a21a0ac', 'volume_name': 'volume-c971751a-ac28-46fc-9d9c-f01c7a21a0ac', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4942839b-6f59-49a6-a1e8-87b4039fb1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4942839b-6f59-49a6-a1e8-87b4039fb1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:46 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2641026-4f2f-447c-856c-a169b6c70b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:46 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] Volume c971751a-ac28-46fc-9d9c-f01c7a21a0ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c971751a-ac28-46fc-9d9c-f01c7a21a0ac', 'volume_size': 1}
Nov 05 09:44:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:44:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:44:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-949148461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c971751a-ac28-46fc-9d9c-f01c7a21a0ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c08c09f1693b40bfb5a39234802acd3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:44:47Z,use_quota=True,user_id='9ff4b322b13b4370ac60487543381cb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:44:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] Creating volume c971751a-ac28-46fc-9d9c-f01c7a21a0ac {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:44:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:44:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:44:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:44:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:44:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:44:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:44:46 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:44:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c971751a-ac28-46fc-9d9c-f01c7a21a0ac 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:46 devstack sudo[100021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c971751a-ac28-46fc-9d9c-f01c7a21a0ac 1073741824
Nov 05 09:44:46 devstack sudo[100021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:47 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ecfdbb9d-c719-446d-be94-6457902cef8c tempest-GroupsTest-859818540 None] Group tempest-Group1-977144661: creating
Nov 05 09:44:47 devstack sudo[100021]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c971751a-ac28-46fc-9d9c-f01c7a21a0ac 1073741824" returned: 0 in 0.592s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:47 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ecfdbb9d-c719-446d-be94-6457902cef8c tempest-GroupsTest-859818540 None] Group tempest-Group1-977144661: created successfully
Nov 05 09:44:47 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ecfdbb9d-c719-446d-be94-6457902cef8c tempest-GroupsTest-859818540 None] Create group completed successfully.
Nov 05 09:44:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c971751a-ac28-46fc-9d9c-f01c7a21a0ac {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:47 devstack sudo[100028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c971751a-ac28-46fc-9d9c-f01c7a21a0ac
Nov 05 09:44:47 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:47 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c971751a-ac28-46fc-9d9c-f01c7a21a0ac" returned: 0 in 0.288s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:44:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:44:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2641026-4f2f-447c-856c-a169b6c70b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c971751a-ac28-46fc-9d9c-f01c7a21a0ac', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c60a72e-ea1b-427a-a554-284764e91d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:47 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] Volume volume-c971751a-ac28-46fc-9d9c-f01c7a21a0ac (c971751a-ac28-46fc-9d9c-f01c7a21a0ac): created successfully
Nov 05 09:44:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c60a72e-ea1b-427a-a554-284764e91d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] Flow 'volume_create_manager' (72b0f924-8d99-4549-8209-98df7e62a5d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:44:47 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-5f7b6c93-fd64-4b69-9736-aed36f216ca1 tempest-TestStampPattern-392278876 None] Created volume successfully.
Nov 05 09:44:48 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:44:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Flow 'volume_create_manager' (b66e21f8-27e6-4cf6-aa8f-a1d3cfbf80f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:44:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0488f02-b7b6-4f6c-82db-2c9095dea53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0488f02-b7b6-4f6c-82db-2c9095dea53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:44:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1854956658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8dd5520-326c-4f4b-a2ce-917580b4c581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12ac60f17ed04c0c9780a610b5ce7734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:44:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:44:48Z,use_quota=True,user_id='e98c7d1807d34178afdfc641d27c4466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e928c9b4-f72b-4ac4-b67f-2168174be6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e928c9b4-f72b-4ac4-b67f-2168174be6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ad23f9-03fb-4924-a64b-49cc459e8548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ad23f9-03fb-4924-a64b-49cc459e8548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8dd5520-326c-4f4b-a2ce-917580b4c581', 'volume_name': 'volume-b8dd5520-326c-4f4b-a2ce-917580b4c581', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265e4343-2a2e-4d5d-93af-3e4b8ae18900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265e4343-2a2e-4d5d-93af-3e4b8ae18900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:48 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (564eab7e-8d85-4d9e-915b-03c20da06bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:48 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Volume b8dd5520-326c-4f4b-a2ce-917580b4c581: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8dd5520-326c-4f4b-a2ce-917580b4c581', 'volume_size': 1}
Nov 05 09:44:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:44:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:44:48 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:44:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1854956658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8dd5520-326c-4f4b-a2ce-917580b4c581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12ac60f17ed04c0c9780a610b5ce7734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:44:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:44:48Z,use_quota=True,user_id='e98c7d1807d34178afdfc641d27c4466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:44:48 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Creating volume b8dd5520-326c-4f4b-a2ce-917580b4c581 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:44:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:44:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:44:48 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:44:48 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:44:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:44:48 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:44:48 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:44:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b8dd5520-326c-4f4b-a2ce-917580b4c581 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:48 devstack sudo[100034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b8dd5520-326c-4f4b-a2ce-917580b4c581 1073741824
Nov 05 09:44:48 devstack sudo[100034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:48 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-5f3004f7-7d65-467b-9a4c-25a12ac5ce86 tempest-GroupsTest-859818540 None] Group tempest-Group2-959058951: creating
Nov 05 09:44:48 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-5f3004f7-7d65-467b-9a4c-25a12ac5ce86 tempest-GroupsTest-859818540 None] Group tempest-Group2-959058951: created successfully
Nov 05 09:44:48 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-5f3004f7-7d65-467b-9a4c-25a12ac5ce86 tempest-GroupsTest-859818540 None] Create group completed successfully.
Nov 05 09:44:48 devstack sudo[100034]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b8dd5520-326c-4f4b-a2ce-917580b4c581 1073741824" returned: 0 in 0.549s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b8dd5520-326c-4f4b-a2ce-917580b4c581 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:48 devstack sudo[100040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b8dd5520-326c-4f4b-a2ce-917580b4c581
Nov 05 09:44:48 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:49 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b8dd5520-326c-4f4b-a2ce-917580b4c581" returned: 0 in 0.280s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:44:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:44:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (564eab7e-8d85-4d9e-915b-03c20da06bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8dd5520-326c-4f4b-a2ce-917580b4c581', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c40be31f-bb31-49d5-a410-df8852bcda79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:49 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Volume volume-b8dd5520-326c-4f4b-a2ce-917580b4c581 (b8dd5520-326c-4f4b-a2ce-917580b4c581): created successfully
Nov 05 09:44:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c40be31f-bb31-49d5-a410-df8852bcda79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Flow 'volume_create_manager' (b66e21f8-27e6-4cf6-aa8f-a1d3cfbf80f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:44:49 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-7cd06aa9-fc7f-44df-acb9-02d2c38a6ef6 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Created volume successfully.
Nov 05 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] Flow 'volume_create_manager' (bddcd8fd-2cec-4fbb-96c2-f74d09168b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c64226a-d9dd-4ba4-8e1e-4de70f9e3a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c64226a-d9dd-4ba4-8e1e-4de70f9e3a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-108988274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=835faf38-f2a2-49e7-a4c6-0056bd4a4c24,host='devstack@QuobyteHD#QuobyteHD',id=2abd0575-7317-4348-9c11-6b033d842630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe5ccc02831416caf08360ba4c2eff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:44:50Z,use_quota=True,user_id='f14bb0d7c4e74063b1db7b32c099a6ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7749c96-442a-47b4-8b6f-cb7fadbb49ac),volume_type_id=a7749c96-442a-47b4-8b6f-cb7fadbb49ac)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9977d08a-1a2f-4295-ab96-a158e0231c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9977d08a-1a2f-4295-ab96-a158e0231c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17493419-108a-4261-83a4-608a5a70175f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17493419-108a-4261-83a4-608a5a70175f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2abd0575-7317-4348-9c11-6b033d842630', 'volume_name': 'volume-2abd0575-7317-4348-9c11-6b033d842630', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b50a879-2213-4192-9cd7-dab839358592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b50a879-2213-4192-9cd7-dab839358592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a331243-3678-460f-add7-f3ce84e18a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:50 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] Volume 2abd0575-7317-4348-9c11-6b033d842630: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2abd0575-7317-4348-9c11-6b033d842630', 'volume_size': 1}
Nov 05 09:44:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:44:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=835faf38-f2a2-49e7-a4c6-0056bd4a4c24,created_at=2026-11-05T08:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-108988274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=835faf38-f2a2-49e7-a4c6-0056bd4a4c24,host='devstack@QuobyteHD#QuobyteHD',id=2abd0575-7317-4348-9c11-6b033d842630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe5ccc02831416caf08360ba4c2eff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:44:50Z,use_quota=True,user_id='f14bb0d7c4e74063b1db7b32c099a6ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7749c96-442a-47b4-8b6f-cb7fadbb49ac),volume_type_id=a7749c96-442a-47b4-8b6f-cb7fadbb49ac)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] Creating volume 2abd0575-7317-4348-9c11-6b033d842630 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:44:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:44:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:44:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:44:50 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:44:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2abd0575-7317-4348-9c11-6b033d842630 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:50 devstack sudo[100060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2abd0575-7317-4348-9c11-6b033d842630 1073741824
Nov 05 09:44:50 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Flow 'volume_create_manager' (2df856cd-d0f3-4481-af33-c75621107592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11239c09-7250-484f-908a-e51c626e04ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11239c09-7250-484f-908a-e51c626e04ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1465261857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36dc320a-d438-44c8-a532-766b686316be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12ac60f17ed04c0c9780a610b5ce7734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:44:51Z,use_quota=True,user_id='e98c7d1807d34178afdfc641d27c4466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc782357-335b-470a-a132-9d1009d147a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc782357-335b-470a-a132-9d1009d147a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (935d7e66-9d98-4358-adf3-6c490b813327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (935d7e66-9d98-4358-adf3-6c490b813327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36dc320a-d438-44c8-a532-766b686316be', 'volume_name': 'volume-36dc320a-d438-44c8-a532-766b686316be', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f07ca8-fa38-4167-9386-b176482e9f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f07ca8-fa38-4167-9386-b176482e9f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b24cdb8-ceec-48be-9d4f-86a69a95004d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:50 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Volume 36dc320a-d438-44c8-a532-766b686316be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36dc320a-d438-44c8-a532-766b686316be', 'volume_size': 1}
Nov 05 09:44:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:44:51 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2abd0575-7317-4348-9c11-6b033d842630 1073741824" returned: 0 in 0.633s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Flow 'volume_create_manager' (8d562d07-1fc1-4fae-ac49-d892ea571bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a49c1d33-96b3-4b89-ae61-a586e9df09c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a49c1d33-96b3-4b89-ae61-a586e9df09c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1900753397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1604ea9a-15ae-4657-b1fe-5f4d0af269e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12ac60f17ed04c0c9780a610b5ce7734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:44:51Z,use_quota=True,user_id='e98c7d1807d34178afdfc641d27c4466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8c4aab8-ec67-46ac-ac56-2d20ac500dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8c4aab8-ec67-46ac-ac56-2d20ac500dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28742840-ac67-4401-953b-b696c78f50db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28742840-ac67-4401-953b-b696c78f50db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1604ea9a-15ae-4657-b1fe-5f4d0af269e9', 'volume_name': 'volume-1604ea9a-15ae-4657-b1fe-5f4d0af269e9', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (788d7cd8-4be0-4a73-99a2-d1e4f73aaeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (788d7cd8-4be0-4a73-99a2-d1e4f73aaeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee9f4d66-d3ed-4415-b0b7-ff234180d3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:51 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Volume 1604ea9a-15ae-4657-b1fe-5f4d0af269e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1604ea9a-15ae-4657-b1fe-5f4d0af269e9', 'volume_size': 1}
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2abd0575-7317-4348-9c11-6b033d842630 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:51 devstack sudo[100067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2abd0575-7317-4348-9c11-6b033d842630
Nov 05 09:44:51 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:51 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2abd0575-7317-4348-9c11-6b033d842630" returned: 0 in 0.363s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.769s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1465261857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36dc320a-d438-44c8-a532-766b686316be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12ac60f17ed04c0c9780a610b5ce7734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:44:51Z,use_quota=True,user_id='e98c7d1807d34178afdfc641d27c4466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Creating volume 36dc320a-d438-44c8-a532-766b686316be {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:44:51 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-36dc320a-d438-44c8-a532-766b686316be 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a331243-3678-460f-add7-f3ce84e18a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2abd0575-7317-4348-9c11-6b033d842630', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:51 devstack sudo[100070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-36dc320a-d438-44c8-a532-766b686316be 1073741824
Nov 05 09:44:51 devstack sudo[100070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ba9fac-02a5-4205-8e80-3f4639ea358a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:51 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] Volume volume-2abd0575-7317-4348-9c11-6b033d842630 (2abd0575-7317-4348-9c11-6b033d842630): created successfully
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ba9fac-02a5-4205-8e80-3f4639ea358a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] Flow 'volume_create_manager' (bddcd8fd-2cec-4fbb-96c2-f74d09168b07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Flow 'volume_create_manager' (20c67095-3223-48e4-856b-59dae2f4dfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0f0f8c8-cff7-4614-96e9-564542eb49f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:51 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f47bb614-1467-41be-b823-e56b51c57291 tempest-GroupsTest-859818540 None] Created volume successfully.
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0f0f8c8-cff7-4614-96e9-564542eb49f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1848970905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9819e52-4ea1-47c4-ad1e-a5a2e2ce4355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12ac60f17ed04c0c9780a610b5ce7734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:44:52Z,use_quota=True,user_id='e98c7d1807d34178afdfc641d27c4466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abcd0071-cc90-4698-886b-9e831f57bdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abcd0071-cc90-4698-886b-9e831f57bdfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4061b57c-f56a-4ee5-a9a9-ae7f7bcf9459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4061b57c-f56a-4ee5-a9a9-ae7f7bcf9459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9819e52-4ea1-47c4-ad1e-a5a2e2ce4355', 'volume_name': 'volume-b9819e52-4ea1-47c4-ad1e-a5a2e2ce4355', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1949cc5e-2d52-45cf-a944-187612cff812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1949cc5e-2d52-45cf-a944-187612cff812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94aea579-04c0-4c72-8f44-db3f05c45115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:52 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Volume b9819e52-4ea1-47c4-ad1e-a5a2e2ce4355: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9819e52-4ea1-47c4-ad1e-a5a2e2ce4355', 'volume_size': 1}
Nov 05 09:44:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Flow 'volume_create_manager' (4bb6f741-36a8-40a9-b3f0-94f4e5974ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8f478de-c5e5-4d9f-b54d-33346d207eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8f478de-c5e5-4d9f-b54d-33346d207eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1017483445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a956c8a-1703-4bcf-9a89-cc05da13221c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12ac60f17ed04c0c9780a610b5ce7734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:44:52Z,use_quota=True,user_id='e98c7d1807d34178afdfc641d27c4466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4500fe40-37a3-4591-b436-248972ad50ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4500fe40-37a3-4591-b436-248972ad50ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (933267b5-d891-4e97-8696-6a25b995e65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (933267b5-d891-4e97-8696-6a25b995e65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a956c8a-1703-4bcf-9a89-cc05da13221c', 'volume_name': 'volume-8a956c8a-1703-4bcf-9a89-cc05da13221c', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e373519-d0ff-4634-a96d-d708ed70199f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e373519-d0ff-4634-a96d-d708ed70199f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0658b09c-9bd0-450d-b851-2b844360fedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:52 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Volume 8a956c8a-1703-4bcf-9a89-cc05da13221c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a956c8a-1703-4bcf-9a89-cc05da13221c', 'volume_size': 1}
Nov 05 09:44:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:44:52 devstack sudo[100070]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-36dc320a-d438-44c8-a532-766b686316be 1073741824" returned: 0 in 0.894s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-36dc320a-d438-44c8-a532-766b686316be {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:52 devstack sudo[100118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-36dc320a-d438-44c8-a532-766b686316be
Nov 05 09:44:52 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:44:53 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Flow 'volume_create_manager' (bc49f698-a470-4a2b-9c86-135cd8251dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (630acfd2-acb2-425a-8ebc-9e86f6206b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-36dc320a-d438-44c8-a532-766b686316be" returned: 0 in 0.417s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:44:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:44:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.773s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1900753397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1604ea9a-15ae-4657-b1fe-5f4d0af269e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12ac60f17ed04c0c9780a610b5ce7734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:44:51Z,use_quota=True,user_id='e98c7d1807d34178afdfc641d27c4466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Creating volume 1604ea9a-15ae-4657-b1fe-5f4d0af269e9 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:44:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:44:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:44:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:44:53 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:44:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1604ea9a-15ae-4657-b1fe-5f4d0af269e9 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b24cdb8-ceec-48be-9d4f-86a69a95004d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36dc320a-d438-44c8-a532-766b686316be', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:53 devstack sudo[100131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1604ea9a-15ae-4657-b1fe-5f4d0af269e9 1073741824
Nov 05 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47cfa289-997b-4a30-84fe-92ef03886333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:53 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (630acfd2-acb2-425a-8ebc-9e86f6206b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1767033848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52eb14e5-07a1-458b-85af-794025b3a0a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12ac60f17ed04c0c9780a610b5ce7734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:44:53Z,use_quota=True,user_id='e98c7d1807d34178afdfc641d27c4466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d41bac13-3722-464e-b366-99f63b5c17b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d41bac13-3722-464e-b366-99f63b5c17b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (305bf563-f18d-4530-877d-344878c68dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (305bf563-f18d-4530-877d-344878c68dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52eb14e5-07a1-458b-85af-794025b3a0a5', 'volume_name': 'volume-52eb14e5-07a1-458b-85af-794025b3a0a5', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d11f4cb-089f-4b11-ae9e-e0c39a544f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d11f4cb-089f-4b11-ae9e-e0c39a544f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a4865f-9ad6-4bae-b815-c87ab36eff8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:53 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Volume 52eb14e5-07a1-458b-85af-794025b3a0a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52eb14e5-07a1-458b-85af-794025b3a0a5', 'volume_size': 1}
Nov 05 09:44:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:44:53 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Volume volume-36dc320a-d438-44c8-a532-766b686316be (36dc320a-d438-44c8-a532-766b686316be): created successfully
Nov 05 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47cfa289-997b-4a30-84fe-92ef03886333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Flow 'volume_create_manager' (2df856cd-d0f3-4481-af33-c75621107592) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:44:53 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-d7de70b0-a1a1-4213-bbbe-d1ba3b35d295 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Created volume successfully.
Nov 05 09:44:53 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1604ea9a-15ae-4657-b1fe-5f4d0af269e9 1073741824" returned: 0 in 0.618s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1604ea9a-15ae-4657-b1fe-5f4d0af269e9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:53 devstack sudo[100149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1604ea9a-15ae-4657-b1fe-5f4d0af269e9
Nov 05 09:44:53 devstack sudo[100149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9bc5276f-2c5b-45f0-90e3-b74146c897ac tempest-GroupsTest-859818540 None] Acquiring lock "cinder-quobyte-2abd0575-7317-4348-9c11-6b033d842630" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:44:54 devstack sudo[100149]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1604ea9a-15ae-4657-b1fe-5f4d0af269e9" returned: 0 in 0.333s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9bc5276f-2c5b-45f0-90e3-b74146c897ac tempest-GroupsTest-859818540 None] Lock "cinder-quobyte-2abd0575-7317-4348-9c11-6b033d842630" acquired by "delete_volume" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.128s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1848970905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9819e52-4ea1-47c4-ad1e-a5a2e2ce4355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12ac60f17ed04c0c9780a610b5ce7734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:44:52Z,use_quota=True,user_id='e98c7d1807d34178afdfc641d27c4466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Creating volume b9819e52-4ea1-47c4-ad1e-a5a2e2ce4355 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:44:54 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b9819e52-4ea1-47c4-ad1e-a5a2e2ce4355 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee9f4d66-d3ed-4415-b0b7-ff234180d3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1604ea9a-15ae-4657-b1fe-5f4d0af269e9', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:54 devstack sudo[100152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b9819e52-4ea1-47c4-ad1e-a5a2e2ce4355 1073741824
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6515d8bf-471b-4ca3-8a86-1b2f6d64aedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:54 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[39aac814-b624-4a7e-b937-fbdd09eed6fc]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9bc5276f-2c5b-45f0-90e3-b74146c897ac tempest-GroupsTest-859818540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2abd0575-7317-4348-9c11-6b033d842630 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:54 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Volume volume-1604ea9a-15ae-4657-b1fe-5f4d0af269e9 (1604ea9a-15ae-4657-b1fe-5f4d0af269e9): created successfully
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6515d8bf-471b-4ca3-8a86-1b2f6d64aedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Flow 'volume_create_manager' (8d562d07-1fc1-4fae-ac49-d892ea571bc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:44:54 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-37c65cf1-ec4a-4604-9626-d5d239c80245 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Created volume successfully.
Nov 05 09:44:54 devstack sudo[100154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2abd0575-7317-4348-9c11-6b033d842630
Nov 05 09:44:54 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:54 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9bc5276f-2c5b-45f0-90e3-b74146c897ac tempest-GroupsTest-859818540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2abd0575-7317-4348-9c11-6b033d842630" returned: 0 in 0.431s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9bc5276f-2c5b-45f0-90e3-b74146c897ac tempest-GroupsTest-859818540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2abd0575-7317-4348-9c11-6b033d842630 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:54 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b9819e52-4ea1-47c4-ad1e-a5a2e2ce4355 1073741824" returned: 0 in 0.482s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:54 devstack sudo[100163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2abd0575-7317-4348-9c11-6b033d842630
Nov 05 09:44:54 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b9819e52-4ea1-47c4-ad1e-a5a2e2ce4355 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:54 devstack sudo[100165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b9819e52-4ea1-47c4-ad1e-a5a2e2ce4355
Nov 05 09:44:54 devstack sudo[100165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:54 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9bc5276f-2c5b-45f0-90e3-b74146c897ac tempest-GroupsTest-859818540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2abd0575-7317-4348-9c11-6b033d842630" returned: 0 in 0.272s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9bc5276f-2c5b-45f0-90e3-b74146c897ac tempest-GroupsTest-859818540 None] Lock "cinder-quobyte-2abd0575-7317-4348-9c11-6b033d842630" released by "delete_volume" :: held 0.777s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:44:54 devstack sudo[100165]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b9819e52-4ea1-47c4-ad1e-a5a2e2ce4355" returned: 0 in 0.264s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.346s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1017483445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a956c8a-1703-4bcf-9a89-cc05da13221c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12ac60f17ed04c0c9780a610b5ce7734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:44:52Z,use_quota=True,user_id='e98c7d1807d34178afdfc641d27c4466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Creating volume 8a956c8a-1703-4bcf-9a89-cc05da13221c {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:44:54 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:44:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8a956c8a-1703-4bcf-9a89-cc05da13221c 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94aea579-04c0-4c72-8f44-db3f05c45115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9819e52-4ea1-47c4-ad1e-a5a2e2ce4355', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:55 devstack sudo[100169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8a956c8a-1703-4bcf-9a89-cc05da13221c 1073741824
Nov 05 09:44:55 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a645b3ed-09a7-40f6-bcc4-485f9e732dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:55 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Volume volume-b9819e52-4ea1-47c4-ad1e-a5a2e2ce4355 (b9819e52-4ea1-47c4-ad1e-a5a2e2ce4355): created successfully
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a645b3ed-09a7-40f6-bcc4-485f9e732dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Flow 'volume_create_manager' (20c67095-3223-48e4-856b-59dae2f4dfec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:44:55 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ff01eabe-7e05-4c59-af6d-3acfd4cdbf2b tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Created volume successfully.
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-9bc5276f-2c5b-45f0-90e3-b74146c897ac tempest-GroupsTest-859818540 None] Created reservations ['f1ffb458-bba9-4f2b-a32f-f5b7b0ef335d'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:44:55 devstack cinder-volume[86649]: WARNING cinder.quota [None req-9bc5276f-2c5b-45f0-90e3-b74146c897ac tempest-GroupsTest-859818540 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-938848905 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-938848905, it is now deprecated. Please use the default quota class for default quota.
Nov 05 09:44:55 devstack cinder-volume[86649]: WARNING cinder.quota [None req-9bc5276f-2c5b-45f0-90e3-b74146c897ac tempest-GroupsTest-859818540 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-938848905 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-938848905, it is now deprecated. Please use the default quota class for default quota.
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-9bc5276f-2c5b-45f0-90e3-b74146c897ac tempest-GroupsTest-859818540 None] Created reservations ['f83a15c1-cb04-4d0f-8c2e-9ade44ad3f2d', 'c238f1f1-d7fb-45e4-815c-77486b4ab454', 'a17ddbe0-78cb-407a-a54b-0a50ac292191', '0316336b-859d-486d-9ae6-f8c4a5202c7a'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9bc5276f-2c5b-45f0-90e3-b74146c897ac tempest-GroupsTest-859818540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9bc5276f-2c5b-45f0-90e3-b74146c897ac tempest-GroupsTest-859818540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9bc5276f-2c5b-45f0-90e3-b74146c897ac tempest-GroupsTest-859818540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9bc5276f-2c5b-45f0-90e3-b74146c897ac tempest-GroupsTest-859818540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9bc5276f-2c5b-45f0-90e3-b74146c897ac tempest-GroupsTest-859818540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9bc5276f-2c5b-45f0-90e3-b74146c897ac tempest-GroupsTest-859818540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:55 devstack sudo[100174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:44:55 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-74397cbb-3a31-45df-a08d-f06ad4f41838 tempest-GroupsTest-859818540 None] Created reservations ['88fc406a-a9c0-45b0-8766-b62bacee8bc0'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:44:55 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8a956c8a-1703-4bcf-9a89-cc05da13221c 1073741824" returned: 0 in 0.556s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:55 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9bc5276f-2c5b-45f0-90e3-b74146c897ac tempest-GroupsTest-859818540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.284s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-9bc5276f-2c5b-45f0-90e3-b74146c897ac tempest-GroupsTest-859818540 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:44:55 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-9bc5276f-2c5b-45f0-90e3-b74146c897ac tempest-GroupsTest-859818540 None] Delete group completed successfully.
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8a956c8a-1703-4bcf-9a89-cc05da13221c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-74397cbb-3a31-45df-a08d-f06ad4f41838 tempest-GroupsTest-859818540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-74397cbb-3a31-45df-a08d-f06ad4f41838 tempest-GroupsTest-859818540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-74397cbb-3a31-45df-a08d-f06ad4f41838 tempest-GroupsTest-859818540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-74397cbb-3a31-45df-a08d-f06ad4f41838 tempest-GroupsTest-859818540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-74397cbb-3a31-45df-a08d-f06ad4f41838 tempest-GroupsTest-859818540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-74397cbb-3a31-45df-a08d-f06ad4f41838 tempest-GroupsTest-859818540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:55 devstack sudo[100178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8a956c8a-1703-4bcf-9a89-cc05da13221c
Nov 05 09:44:55 devstack sudo[100178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:55 devstack sudo[100179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:44:55 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:55 devstack sudo[100178]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8a956c8a-1703-4bcf-9a89-cc05da13221c" returned: 0 in 0.274s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.611s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1767033848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52eb14e5-07a1-458b-85af-794025b3a0a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12ac60f17ed04c0c9780a610b5ce7734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:44:53Z,use_quota=True,user_id='e98c7d1807d34178afdfc641d27c4466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Creating volume 52eb14e5-07a1-458b-85af-794025b3a0a5 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:44:55 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-52eb14e5-07a1-458b-85af-794025b3a0a5 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:55 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-74397cbb-3a31-45df-a08d-f06ad4f41838 tempest-GroupsTest-859818540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.287s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-74397cbb-3a31-45df-a08d-f06ad4f41838 tempest-GroupsTest-859818540 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:44:55 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-74397cbb-3a31-45df-a08d-f06ad4f41838 tempest-GroupsTest-859818540 None] Delete group completed successfully.
Nov 05 09:44:55 devstack sudo[100184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-52eb14e5-07a1-458b-85af-794025b3a0a5 1073741824
Nov 05 09:44:55 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0658b09c-9bd0-450d-b851-2b844360fedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a956c8a-1703-4bcf-9a89-cc05da13221c', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f7e1247-85d0-4596-bb51-1e10f871d0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:55 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Volume volume-8a956c8a-1703-4bcf-9a89-cc05da13221c (8a956c8a-1703-4bcf-9a89-cc05da13221c): created successfully
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f7e1247-85d0-4596-bb51-1e10f871d0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:55 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Flow 'volume_create_manager' (4bb6f741-36a8-40a9-b3f0-94f4e5974ad9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:44:55 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-58e6efab-1eb3-4c11-8de8-f8447f80968d tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Created volume successfully.
Nov 05 09:44:56 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-52eb14e5-07a1-458b-85af-794025b3a0a5 1073741824" returned: 0 in 0.484s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-52eb14e5-07a1-458b-85af-794025b3a0a5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:56 devstack sudo[100190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-52eb14e5-07a1-458b-85af-794025b3a0a5
Nov 05 09:44:56 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:56 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-52eb14e5-07a1-458b-85af-794025b3a0a5" returned: 0 in 0.258s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:44:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:44:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a4865f-9ad6-4bae-b815-c87ab36eff8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52eb14e5-07a1-458b-85af-794025b3a0a5', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73172762-7f07-49ff-bbc4-614a7326a2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:56 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Volume volume-52eb14e5-07a1-458b-85af-794025b3a0a5 (52eb14e5-07a1-458b-85af-794025b3a0a5): created successfully
Nov 05 09:44:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73172762-7f07-49ff-bbc4-614a7326a2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Flow 'volume_create_manager' (bc49f698-a470-4a2b-9c86-135cd8251dc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:44:56 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-dd866523-36e8-4a27-a30a-a19d90ab2a4a tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Created volume successfully.
Nov 05 09:44:57 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b723dc46-1cb8-4644-98ad-b1330c7c42e9 tempest-GroupsTest-859818540 None] Group tempest-GroupsTest-Group-707915372: creating
Nov 05 09:44:57 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b723dc46-1cb8-4644-98ad-b1330c7c42e9 tempest-GroupsTest-859818540 None] Group tempest-GroupsTest-Group-707915372: created successfully
Nov 05 09:44:57 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b723dc46-1cb8-4644-98ad-b1330c7c42e9 tempest-GroupsTest-859818540 None] Create group completed successfully.
Nov 05 09:44:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b9aeeeb4-8324-4677-8ea8-664172fe2bd3 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Acquiring lock "cinder-52eb14e5-07a1-458b-85af-794025b3a0a5-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:44:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b9aeeeb4-8324-4677-8ea8-664172fe2bd3 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "cinder-52eb14e5-07a1-458b-85af-794025b3a0a5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:44:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b9aeeeb4-8324-4677-8ea8-664172fe2bd3 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Acquiring lock "cinder-quobyte-52eb14e5-07a1-458b-85af-794025b3a0a5" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:44:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b9aeeeb4-8324-4677-8ea8-664172fe2bd3 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "cinder-quobyte-52eb14e5-07a1-458b-85af-794025b3a0a5" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:44:57 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[680ddc92-22b8-4ed3-a6be-ef5c9ff70109]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:44:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b9aeeeb4-8324-4677-8ea8-664172fe2bd3 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-52eb14e5-07a1-458b-85af-794025b3a0a5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:57 devstack sudo[100193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-52eb14e5-07a1-458b-85af-794025b3a0a5
Nov 05 09:44:57 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:58 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b9aeeeb4-8324-4677-8ea8-664172fe2bd3 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-52eb14e5-07a1-458b-85af-794025b3a0a5" returned: 0 in 0.388s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b9aeeeb4-8324-4677-8ea8-664172fe2bd3 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-52eb14e5-07a1-458b-85af-794025b3a0a5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:58 devstack sudo[100198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-52eb14e5-07a1-458b-85af-794025b3a0a5
Nov 05 09:44:58 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:58 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b9aeeeb4-8324-4677-8ea8-664172fe2bd3 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-52eb14e5-07a1-458b-85af-794025b3a0a5" returned: 0 in 0.265s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:58 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b9aeeeb4-8324-4677-8ea8-664172fe2bd3 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "cinder-quobyte-52eb14e5-07a1-458b-85af-794025b3a0a5" released by "delete_volume" :: held 0.703s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:44:58 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-b9aeeeb4-8324-4677-8ea8-664172fe2bd3 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Created reservations ['7c30ddfb-aa93-4f9f-953c-6101082bf88b', 'f8e0fcb2-e0b8-4a58-afcd-6b035f6af0a9', 'e0a796c7-e971-4ff9-a2d1-86b40e31d5c4', '20d00703-2969-4555-a82e-55ad0ac0fddb'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:44:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b9aeeeb4-8324-4677-8ea8-664172fe2bd3 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:44:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b9aeeeb4-8324-4677-8ea8-664172fe2bd3 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:44:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b9aeeeb4-8324-4677-8ea8-664172fe2bd3 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:44:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b9aeeeb4-8324-4677-8ea8-664172fe2bd3 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:44:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b9aeeeb4-8324-4677-8ea8-664172fe2bd3 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:44:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b9aeeeb4-8324-4677-8ea8-664172fe2bd3 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:58 devstack sudo[100201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:44:58 devstack sudo[100201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:58 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fbbac212-a43c-4f50-ac20-a8db765b74b4 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Acquiring lock "cinder-8a956c8a-1703-4bcf-9a89-cc05da13221c-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:44:58 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fbbac212-a43c-4f50-ac20-a8db765b74b4 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "cinder-8a956c8a-1703-4bcf-9a89-cc05da13221c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:44:58 devstack sudo[100201]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b9aeeeb4-8324-4677-8ea8-664172fe2bd3 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.336s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:58 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-b9aeeeb4-8324-4677-8ea8-664172fe2bd3 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:44:58 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b9aeeeb4-8324-4677-8ea8-664172fe2bd3 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Deleted volume successfully.
Nov 05 09:44:58 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fbbac212-a43c-4f50-ac20-a8db765b74b4 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Acquiring lock "cinder-quobyte-8a956c8a-1703-4bcf-9a89-cc05da13221c" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:44:58 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b9aeeeb4-8324-4677-8ea8-664172fe2bd3 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "cinder-52eb14e5-07a1-458b-85af-794025b3a0a5-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:44:58 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fbbac212-a43c-4f50-ac20-a8db765b74b4 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "cinder-quobyte-8a956c8a-1703-4bcf-9a89-cc05da13221c" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:44:58 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[62452789-2d5a-46a2-9b35-356fea18eacc]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:44:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fbbac212-a43c-4f50-ac20-a8db765b74b4 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8a956c8a-1703-4bcf-9a89-cc05da13221c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:58 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:44:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] Flow 'volume_create_manager' (d6ca3d27-1ffd-427f-acb6-9faeea382593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:44:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45d1ffdf-11bc-425d-b69a-dfcb76e1df0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45d1ffdf-11bc-425d-b69a-dfcb76e1df0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-733237891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=089efd6f-cd39-40b3-b05c-11e617671d84,host='devstack@QuobyteHD#QuobyteHD',id=41276b2b-9722-46d0-a50d-7bac030c43ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe5ccc02831416caf08360ba4c2eff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:44:59Z,use_quota=True,user_id='f14bb0d7c4e74063b1db7b32c099a6ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2804dc9b-eb24-4d8d-984e-1f0a7e446463),volume_type_id=2804dc9b-eb24-4d8d-984e-1f0a7e446463)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52ef1987-a568-4f71-ab1b-8757aa75250f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:59 devstack sudo[100204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8a956c8a-1703-4bcf-9a89-cc05da13221c
Nov 05 09:44:59 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52ef1987-a568-4f71-ab1b-8757aa75250f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a66a87f-252d-4326-9e81-ad2aa646b083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a66a87f-252d-4326-9e81-ad2aa646b083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41276b2b-9722-46d0-a50d-7bac030c43ed', 'volume_name': 'volume-41276b2b-9722-46d0-a50d-7bac030c43ed', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cafc6571-2a85-4eeb-8805-d5e3f039e9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cafc6571-2a85-4eeb-8805-d5e3f039e9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c75cdd19-0d21-4f75-86e5-f2f0849f8d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:59 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] Volume 41276b2b-9722-46d0-a50d-7bac030c43ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41276b2b-9722-46d0-a50d-7bac030c43ed', 'volume_size': 1}
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=089efd6f-cd39-40b3-b05c-11e617671d84,created_at=2026-11-05T08:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-733237891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=089efd6f-cd39-40b3-b05c-11e617671d84,host='devstack@QuobyteHD#QuobyteHD',id=41276b2b-9722-46d0-a50d-7bac030c43ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe5ccc02831416caf08360ba4c2eff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:44:59Z,use_quota=True,user_id='f14bb0d7c4e74063b1db7b32c099a6ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2804dc9b-eb24-4d8d-984e-1f0a7e446463),volume_type_id=2804dc9b-eb24-4d8d-984e-1f0a7e446463)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] Creating volume 41276b2b-9722-46d0-a50d-7bac030c43ed {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:44:59 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41276b2b-9722-46d0-a50d-7bac030c43ed 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:59 devstack sudo[100206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41276b2b-9722-46d0-a50d-7bac030c43ed 1073741824
Nov 05 09:44:59 devstack sudo[100206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:59 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fbbac212-a43c-4f50-ac20-a8db765b74b4 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8a956c8a-1703-4bcf-9a89-cc05da13221c" returned: 0 in 0.409s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fbbac212-a43c-4f50-ac20-a8db765b74b4 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8a956c8a-1703-4bcf-9a89-cc05da13221c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:59 devstack sudo[100215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8a956c8a-1703-4bcf-9a89-cc05da13221c
Nov 05 09:44:59 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:59 devstack sudo[100206]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41276b2b-9722-46d0-a50d-7bac030c43ed 1073741824" returned: 0 in 0.443s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41276b2b-9722-46d0-a50d-7bac030c43ed {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:59 devstack sudo[100218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41276b2b-9722-46d0-a50d-7bac030c43ed
Nov 05 09:44:59 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:59 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fbbac212-a43c-4f50-ac20-a8db765b74b4 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8a956c8a-1703-4bcf-9a89-cc05da13221c" returned: 0 in 0.290s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fbbac212-a43c-4f50-ac20-a8db765b74b4 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "cinder-quobyte-8a956c8a-1703-4bcf-9a89-cc05da13221c" released by "delete_volume" :: held 0.756s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-fbbac212-a43c-4f50-ac20-a8db765b74b4 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Created reservations ['9aa2fc7a-5607-451b-8e51-90d37418a917', '86d69aa8-0c19-4649-b5de-a0704b697e26', 'a7a6f7b8-0b58-4db9-b9a5-44be45264772', 'dba734dc-7007-4192-a736-acb74e2e5ff4'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fbbac212-a43c-4f50-ac20-a8db765b74b4 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fbbac212-a43c-4f50-ac20-a8db765b74b4 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fbbac212-a43c-4f50-ac20-a8db765b74b4 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fbbac212-a43c-4f50-ac20-a8db765b74b4 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fbbac212-a43c-4f50-ac20-a8db765b74b4 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fbbac212-a43c-4f50-ac20-a8db765b74b4 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:44:59 devstack sudo[100221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:44:59 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:44:59 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41276b2b-9722-46d0-a50d-7bac030c43ed" returned: 0 in 0.307s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c75cdd19-0d21-4f75-86e5-f2f0849f8d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41276b2b-9722-46d0-a50d-7bac030c43ed', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e77aea7c-cc54-4d60-83c0-f2ec311f4860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:44:59 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] Volume volume-41276b2b-9722-46d0-a50d-7bac030c43ed (41276b2b-9722-46d0-a50d-7bac030c43ed): created successfully
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e77aea7c-cc54-4d60-83c0-f2ec311f4860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] Flow 'volume_create_manager' (d6ca3d27-1ffd-427f-acb6-9faeea382593) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:44:59 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ea9b2b55-2484-4216-bced-1e6be0710359 tempest-GroupsTest-859818540 None] Created volume successfully.
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-afbd415c-05b2-4f34-a806-a8a57cb9fe7c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Acquiring lock "cinder-b9819e52-4ea1-47c4-ad1e-a5a2e2ce4355-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:44:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-afbd415c-05b2-4f34-a806-a8a57cb9fe7c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "cinder-b9819e52-4ea1-47c4-ad1e-a5a2e2ce4355-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-afbd415c-05b2-4f34-a806-a8a57cb9fe7c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Acquiring lock "cinder-quobyte-b9819e52-4ea1-47c4-ad1e-a5a2e2ce4355" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-afbd415c-05b2-4f34-a806-a8a57cb9fe7c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "cinder-quobyte-b9819e52-4ea1-47c4-ad1e-a5a2e2ce4355" acquired by "delete_volume" :: waited 0.027s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[580d71fd-90c8-4c4c-a29e-9782f936ec01]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-afbd415c-05b2-4f34-a806-a8a57cb9fe7c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b9819e52-4ea1-47c4-ad1e-a5a2e2ce4355 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:00 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fbbac212-a43c-4f50-ac20-a8db765b74b4 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.302s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-fbbac212-a43c-4f50-ac20-a8db765b74b4 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:45:00 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-fbbac212-a43c-4f50-ac20-a8db765b74b4 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Deleted volume successfully.
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fbbac212-a43c-4f50-ac20-a8db765b74b4 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "cinder-8a956c8a-1703-4bcf-9a89-cc05da13221c-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:00 devstack sudo[100224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b9819e52-4ea1-47c4-ad1e-a5a2e2ce4355
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:00 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:00 devstack sudo[100226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:45:00 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:00 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-afbd415c-05b2-4f34-a806-a8a57cb9fe7c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b9819e52-4ea1-47c4-ad1e-a5a2e2ce4355" returned: 0 in 0.430s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-afbd415c-05b2-4f34-a806-a8a57cb9fe7c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b9819e52-4ea1-47c4-ad1e-a5a2e2ce4355 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:00 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.318s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 28 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>, <Thread(tpool_thread_0, started daemon 132223357408960)>, <Thread(tpool_thread_1, started daemon 132223349016256)>, <Thread(tpool_thread_2, started daemon 132223340623552)>, <Thread(tpool_thread_3, started daemon 132223332230848)>, <Thread(tpool_thread_4, started daemon 132223323838144)>, <Thread(tpool_thread_5, started daemon 132223315445440)>, <Thread(tpool_thread_6, started daemon 132223307052736)>, <Thread(tpool_thread_7, started daemon 132223298660032)>, <Thread(tpool_thread_8, started daemon 132223290250944)>, <Thread(tpool_thread_9, started daemon 132223281841856)>, <Thread(tpool_thread_10, started daemon 132223273432768)>, <Thread(tpool_thread_11, started daemon 132223265023680)>, <Thread(tpool_thread_12, started daemon 132223256614592)>, <Thread(tpool_thread_13, started daemon 132223248205504)>, <Thread(tpool_thread_14, started daemon 132223239796416)>, <Thread(tpool_thread_15, started daemon 132223231387328)>, <Thread(tpool_thread_16, started daemon 132223222978240)>, <Thread(tpool_thread_17, started daemon 132223214569152)>, <Thread(tpool_thread_18, started daemon 132223206160064)>, <Thread(tpool_thread_19, started daemon 132223197750976)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:45:00 devstack sudo[100232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b9819e52-4ea1-47c4-ad1e-a5a2e2ce4355
Nov 05 09:45:00 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:00 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-afbd415c-05b2-4f34-a806-a8a57cb9fe7c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b9819e52-4ea1-47c4-ad1e-a5a2e2ce4355" returned: 0 in 0.307s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-afbd415c-05b2-4f34-a806-a8a57cb9fe7c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "cinder-quobyte-b9819e52-4ea1-47c4-ad1e-a5a2e2ce4355" released by "delete_volume" :: held 0.803s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] Flow 'volume_create_manager' (5de2659d-7f47-4f7c-9102-a18bf4bccf90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6056e045-8bb0-4dd4-a814-4fad1004926b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6056e045-8bb0-4dd4-a814-4fad1004926b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1535093898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=089efd6f-cd39-40b3-b05c-11e617671d84,host='devstack@QuobyteHD#QuobyteHD',id=cc462e88-2fee-4ef9-90dc-48564ece4db4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe5ccc02831416caf08360ba4c2eff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:45:01Z,use_quota=True,user_id='f14bb0d7c4e74063b1db7b32c099a6ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2804dc9b-eb24-4d8d-984e-1f0a7e446463),volume_type_id=2804dc9b-eb24-4d8d-984e-1f0a7e446463)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c58c4642-c0e7-42f1-8224-3e929b3d5382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c58c4642-c0e7-42f1-8224-3e929b3d5382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (590cf080-9ebe-4c57-b7d8-3ecc4d37c858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (590cf080-9ebe-4c57-b7d8-3ecc4d37c858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc462e88-2fee-4ef9-90dc-48564ece4db4', 'volume_name': 'volume-cc462e88-2fee-4ef9-90dc-48564ece4db4', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c49e453-7ec4-4232-bcf6-669e3ece8fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c49e453-7ec4-4232-bcf6-669e3ece8fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cd6e388-d666-4382-9e1c-5e9be876438a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:00 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] Volume cc462e88-2fee-4ef9-90dc-48564ece4db4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc462e88-2fee-4ef9-90dc-48564ece4db4', 'volume_size': 1}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=089efd6f-cd39-40b3-b05c-11e617671d84,created_at=2026-11-05T08:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1535093898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=089efd6f-cd39-40b3-b05c-11e617671d84,host='devstack@QuobyteHD#QuobyteHD',id=cc462e88-2fee-4ef9-90dc-48564ece4db4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe5ccc02831416caf08360ba4c2eff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:45:01Z,use_quota=True,user_id='f14bb0d7c4e74063b1db7b32c099a6ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2804dc9b-eb24-4d8d-984e-1f0a7e446463),volume_type_id=2804dc9b-eb24-4d8d-984e-1f0a7e446463)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] Creating volume cc462e88-2fee-4ef9-90dc-48564ece4db4 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:45:00 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:45:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cc462e88-2fee-4ef9-90dc-48564ece4db4 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:00 devstack sudo[100235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cc462e88-2fee-4ef9-90dc-48564ece4db4 1073741824
Nov 05 09:45:00 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:01 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-afbd415c-05b2-4f34-a806-a8a57cb9fe7c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Created reservations ['f9e10c9a-93be-4e25-8d4c-2d6bed4c16d1', 'd2349d85-9825-463c-b760-f66b8af9836d', '7c1d8964-61fc-40df-9067-5628b0577826', 'acfd974e-994a-40be-a686-dac3bfa301c4'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:45:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-afbd415c-05b2-4f34-a806-a8a57cb9fe7c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-afbd415c-05b2-4f34-a806-a8a57cb9fe7c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-afbd415c-05b2-4f34-a806-a8a57cb9fe7c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:45:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-afbd415c-05b2-4f34-a806-a8a57cb9fe7c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:45:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-afbd415c-05b2-4f34-a806-a8a57cb9fe7c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-afbd415c-05b2-4f34-a806-a8a57cb9fe7c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fc8abdaa-19fa-43ca-ad3d-84c9a6cfe1ec tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Acquiring lock "cinder-1604ea9a-15ae-4657-b1fe-5f4d0af269e9-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:01 devstack sudo[100237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:45:01 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fc8abdaa-19fa-43ca-ad3d-84c9a6cfe1ec tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "cinder-1604ea9a-15ae-4657-b1fe-5f4d0af269e9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fc8abdaa-19fa-43ca-ad3d-84c9a6cfe1ec tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Acquiring lock "cinder-quobyte-1604ea9a-15ae-4657-b1fe-5f4d0af269e9" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fc8abdaa-19fa-43ca-ad3d-84c9a6cfe1ec tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "cinder-quobyte-1604ea9a-15ae-4657-b1fe-5f4d0af269e9" acquired by "delete_volume" :: waited 0.026s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:01 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e60f35-cc41-46a4-b505-ba9f7493d9c6]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:45:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fc8abdaa-19fa-43ca-ad3d-84c9a6cfe1ec tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1604ea9a-15ae-4657-b1fe-5f4d0af269e9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:01 devstack sudo[100242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1604ea9a-15ae-4657-b1fe-5f4d0af269e9
Nov 05 09:45:01 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:01 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cc462e88-2fee-4ef9-90dc-48564ece4db4 1073741824" returned: 0 in 0.530s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:01 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-afbd415c-05b2-4f34-a806-a8a57cb9fe7c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.346s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:01 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-afbd415c-05b2-4f34-a806-a8a57cb9fe7c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:45:01 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-afbd415c-05b2-4f34-a806-a8a57cb9fe7c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Deleted volume successfully.
Nov 05 09:45:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-afbd415c-05b2-4f34-a806-a8a57cb9fe7c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "cinder-b9819e52-4ea1-47c4-ad1e-a5a2e2ce4355-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cc462e88-2fee-4ef9-90dc-48564ece4db4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:01 devstack sudo[100246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cc462e88-2fee-4ef9-90dc-48564ece4db4
Nov 05 09:45:01 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:01 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fc8abdaa-19fa-43ca-ad3d-84c9a6cfe1ec tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1604ea9a-15ae-4657-b1fe-5f4d0af269e9" returned: 0 in 0.404s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fc8abdaa-19fa-43ca-ad3d-84c9a6cfe1ec tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1604ea9a-15ae-4657-b1fe-5f4d0af269e9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:01 devstack sudo[100251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1604ea9a-15ae-4657-b1fe-5f4d0af269e9
Nov 05 09:45:01 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:01 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cc462e88-2fee-4ef9-90dc-48564ece4db4" returned: 0 in 0.289s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:45:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cd6e388-d666-4382-9e1c-5e9be876438a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc462e88-2fee-4ef9-90dc-48564ece4db4', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29983a0b-88c3-4ebf-b1cb-4c0538799b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:01 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] Volume volume-cc462e88-2fee-4ef9-90dc-48564ece4db4 (cc462e88-2fee-4ef9-90dc-48564ece4db4): created successfully
Nov 05 09:45:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29983a0b-88c3-4ebf-b1cb-4c0538799b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] Flow 'volume_create_manager' (5de2659d-7f47-4f7c-9102-a18bf4bccf90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:45:01 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-1e22c650-f8c5-42e3-84b2-d70e3677bd76 tempest-GroupsTest-859818540 None] Created volume successfully.
Nov 05 09:45:01 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fc8abdaa-19fa-43ca-ad3d-84c9a6cfe1ec tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1604ea9a-15ae-4657-b1fe-5f4d0af269e9" returned: 0 in 0.285s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fc8abdaa-19fa-43ca-ad3d-84c9a6cfe1ec tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "cinder-quobyte-1604ea9a-15ae-4657-b1fe-5f4d0af269e9" released by "delete_volume" :: held 0.740s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:02 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-fc8abdaa-19fa-43ca-ad3d-84c9a6cfe1ec tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Created reservations ['9cf49df0-324c-41a7-866e-f1703a86b860', '8a817eb2-db0b-4d5e-a0a5-caabde46924b', '934c36cf-8b23-4955-b134-534e92597ca6', 'd9526d42-6ae9-45f5-9f7d-547f56e569b8'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:45:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fc8abdaa-19fa-43ca-ad3d-84c9a6cfe1ec tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fc8abdaa-19fa-43ca-ad3d-84c9a6cfe1ec tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fc8abdaa-19fa-43ca-ad3d-84c9a6cfe1ec tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:45:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fc8abdaa-19fa-43ca-ad3d-84c9a6cfe1ec tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:45:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fc8abdaa-19fa-43ca-ad3d-84c9a6cfe1ec tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fc8abdaa-19fa-43ca-ad3d-84c9a6cfe1ec tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:02 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b580af9d-bfb3-41c3-b2af-2472882420e1 tempest-GroupsTest-859818540 None] Update group completed successfully.
Nov 05 09:45:02 devstack sudo[100258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:45:02 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ebdee9db-dfba-4a6d-b201-c2b03d82b87c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Acquiring lock "cinder-36dc320a-d438-44c8-a532-766b686316be-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ebdee9db-dfba-4a6d-b201-c2b03d82b87c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "cinder-36dc320a-d438-44c8-a532-766b686316be-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ebdee9db-dfba-4a6d-b201-c2b03d82b87c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Acquiring lock "cinder-quobyte-36dc320a-d438-44c8-a532-766b686316be" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:02 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fc8abdaa-19fa-43ca-ad3d-84c9a6cfe1ec tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.278s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:02 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-fc8abdaa-19fa-43ca-ad3d-84c9a6cfe1ec tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:45:02 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-fc8abdaa-19fa-43ca-ad3d-84c9a6cfe1ec tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Deleted volume successfully.
Nov 05 09:45:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ebdee9db-dfba-4a6d-b201-c2b03d82b87c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "cinder-quobyte-36dc320a-d438-44c8-a532-766b686316be" acquired by "delete_volume" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:02 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6bc5e6-69e1-44d8-9c61-31cf70b3b885]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:45:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ebdee9db-dfba-4a6d-b201-c2b03d82b87c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-36dc320a-d438-44c8-a532-766b686316be {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fc8abdaa-19fa-43ca-ad3d-84c9a6cfe1ec tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "cinder-1604ea9a-15ae-4657-b1fe-5f4d0af269e9-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:02 devstack sudo[100261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-36dc320a-d438-44c8-a532-766b686316be
Nov 05 09:45:02 devstack sudo[100261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:02 devstack sudo[100261]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ebdee9db-dfba-4a6d-b201-c2b03d82b87c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-36dc320a-d438-44c8-a532-766b686316be" returned: 0 in 0.371s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ebdee9db-dfba-4a6d-b201-c2b03d82b87c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-36dc320a-d438-44c8-a532-766b686316be {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:02 devstack sudo[100266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-36dc320a-d438-44c8-a532-766b686316be
Nov 05 09:45:02 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:03 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ebdee9db-dfba-4a6d-b201-c2b03d82b87c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-36dc320a-d438-44c8-a532-766b686316be" returned: 0 in 0.268s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ebdee9db-dfba-4a6d-b201-c2b03d82b87c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "cinder-quobyte-36dc320a-d438-44c8-a532-766b686316be" released by "delete_volume" :: held 0.687s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:03 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-ebdee9db-dfba-4a6d-b201-c2b03d82b87c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Created reservations ['fc105370-dc2e-4c3e-b34d-813014388eab', 'c2f44f66-2d95-4f0c-ac53-fd2eba86e948', 'fd3c2c55-2f5e-4bb4-995b-220ca42aa3dd', 'd68acc83-e46b-4376-9b8f-bd1b0a2ad55b'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:45:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ebdee9db-dfba-4a6d-b201-c2b03d82b87c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ebdee9db-dfba-4a6d-b201-c2b03d82b87c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ebdee9db-dfba-4a6d-b201-c2b03d82b87c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:45:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ebdee9db-dfba-4a6d-b201-c2b03d82b87c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:45:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ebdee9db-dfba-4a6d-b201-c2b03d82b87c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ebdee9db-dfba-4a6d-b201-c2b03d82b87c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:03 devstack sudo[100269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:45:03 devstack sudo[100269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b2e5e659-24e9-429b-ba3e-065d86446380 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Acquiring lock "cinder-b8dd5520-326c-4f4b-a2ce-917580b4c581-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b2e5e659-24e9-429b-ba3e-065d86446380 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "cinder-b8dd5520-326c-4f4b-a2ce-917580b4c581-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:03 devstack sudo[100269]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ebdee9db-dfba-4a6d-b201-c2b03d82b87c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.349s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:03 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-ebdee9db-dfba-4a6d-b201-c2b03d82b87c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:45:03 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ebdee9db-dfba-4a6d-b201-c2b03d82b87c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Deleted volume successfully.
Nov 05 09:45:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b2e5e659-24e9-429b-ba3e-065d86446380 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Acquiring lock "cinder-quobyte-b8dd5520-326c-4f4b-a2ce-917580b4c581" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:03 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-101cc304-8f32-4aff-adc7-76e06787f7c9 tempest-GroupsTest-859818540 None] Update group completed successfully.
Nov 05 09:45:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ebdee9db-dfba-4a6d-b201-c2b03d82b87c tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "cinder-36dc320a-d438-44c8-a532-766b686316be-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b2e5e659-24e9-429b-ba3e-065d86446380 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "cinder-quobyte-b8dd5520-326c-4f4b-a2ce-917580b4c581" acquired by "delete_volume" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:03 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[60011a46-d493-4fe8-a065-bdb1f6fce6a7]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:45:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b2e5e659-24e9-429b-ba3e-065d86446380 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b8dd5520-326c-4f4b-a2ce-917580b4c581 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:03 devstack sudo[100273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b8dd5520-326c-4f4b-a2ce-917580b4c581
Nov 05 09:45:03 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:04 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b2e5e659-24e9-429b-ba3e-065d86446380 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b8dd5520-326c-4f4b-a2ce-917580b4c581" returned: 0 in 0.375s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b2e5e659-24e9-429b-ba3e-065d86446380 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b8dd5520-326c-4f4b-a2ce-917580b4c581 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:04 devstack sudo[100278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b8dd5520-326c-4f4b-a2ce-917580b4c581
Nov 05 09:45:04 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:04 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b2e5e659-24e9-429b-ba3e-065d86446380 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b8dd5520-326c-4f4b-a2ce-917580b4c581" returned: 0 in 0.261s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b2e5e659-24e9-429b-ba3e-065d86446380 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "cinder-quobyte-b8dd5520-326c-4f4b-a2ce-917580b4c581" released by "delete_volume" :: held 0.680s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:04 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-b2e5e659-24e9-429b-ba3e-065d86446380 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Created reservations ['2decd172-b741-43f4-91da-7b8b0bcc69c1', 'd0e537f7-2d4b-41c6-b54b-50c8fb152f37', '3d691da3-1456-4d0e-9ec1-0b1d0d2fb410', 'be99c332-a186-4eca-b3b7-510e14e1635f'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:45:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b2e5e659-24e9-429b-ba3e-065d86446380 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b2e5e659-24e9-429b-ba3e-065d86446380 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b2e5e659-24e9-429b-ba3e-065d86446380 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:45:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b2e5e659-24e9-429b-ba3e-065d86446380 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:45:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b2e5e659-24e9-429b-ba3e-065d86446380 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b2e5e659-24e9-429b-ba3e-065d86446380 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:04 devstack sudo[100281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:45:04 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:04 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b2e5e659-24e9-429b-ba3e-065d86446380 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.279s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:04 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-b2e5e659-24e9-429b-ba3e-065d86446380 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:45:04 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b2e5e659-24e9-429b-ba3e-065d86446380 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Deleted volume successfully.
Nov 05 09:45:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b2e5e659-24e9-429b-ba3e-065d86446380 tempest-CreateVolumesFromSourceVolumeTest-1511804899 None] Lock "cinder-b8dd5520-326c-4f4b-a2ce-917580b4c581-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8962058a-e67d-4c4f-875d-52fc243e2ea6 tempest-GroupsTest-859818540 None] Acquiring lock "cinder-quobyte-41276b2b-9722-46d0-a50d-7bac030c43ed" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8962058a-e67d-4c4f-875d-52fc243e2ea6 tempest-GroupsTest-859818540 None] Lock "cinder-quobyte-41276b2b-9722-46d0-a50d-7bac030c43ed" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:05 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc7fde2-6fa9-40bd-9019-4d94a623e447]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:45:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8962058a-e67d-4c4f-875d-52fc243e2ea6 tempest-GroupsTest-859818540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41276b2b-9722-46d0-a50d-7bac030c43ed {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:05 devstack sudo[100284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41276b2b-9722-46d0-a50d-7bac030c43ed
Nov 05 09:45:05 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:05 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8962058a-e67d-4c4f-875d-52fc243e2ea6 tempest-GroupsTest-859818540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41276b2b-9722-46d0-a50d-7bac030c43ed" returned: 0 in 0.428s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8962058a-e67d-4c4f-875d-52fc243e2ea6 tempest-GroupsTest-859818540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41276b2b-9722-46d0-a50d-7bac030c43ed {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:05 devstack sudo[100289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41276b2b-9722-46d0-a50d-7bac030c43ed
Nov 05 09:45:05 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:06 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8962058a-e67d-4c4f-875d-52fc243e2ea6 tempest-GroupsTest-859818540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41276b2b-9722-46d0-a50d-7bac030c43ed" returned: 0 in 0.284s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8962058a-e67d-4c4f-875d-52fc243e2ea6 tempest-GroupsTest-859818540 None] Lock "cinder-quobyte-41276b2b-9722-46d0-a50d-7bac030c43ed" released by "delete_volume" :: held 0.764s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8962058a-e67d-4c4f-875d-52fc243e2ea6 tempest-GroupsTest-859818540 None] Acquiring lock "cinder-quobyte-cc462e88-2fee-4ef9-90dc-48564ece4db4" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8962058a-e67d-4c4f-875d-52fc243e2ea6 tempest-GroupsTest-859818540 None] Lock "cinder-quobyte-cc462e88-2fee-4ef9-90dc-48564ece4db4" acquired by "delete_volume" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:06 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb5072a-5d76-44db-b452-55860e5f2f31]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:45:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8962058a-e67d-4c4f-875d-52fc243e2ea6 tempest-GroupsTest-859818540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cc462e88-2fee-4ef9-90dc-48564ece4db4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:06 devstack sudo[100292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cc462e88-2fee-4ef9-90dc-48564ece4db4
Nov 05 09:45:06 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:06 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8962058a-e67d-4c4f-875d-52fc243e2ea6 tempest-GroupsTest-859818540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cc462e88-2fee-4ef9-90dc-48564ece4db4" returned: 0 in 0.400s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8962058a-e67d-4c4f-875d-52fc243e2ea6 tempest-GroupsTest-859818540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cc462e88-2fee-4ef9-90dc-48564ece4db4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:06 devstack sudo[100298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cc462e88-2fee-4ef9-90dc-48564ece4db4
Nov 05 09:45:06 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:06 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8962058a-e67d-4c4f-875d-52fc243e2ea6 tempest-GroupsTest-859818540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cc462e88-2fee-4ef9-90dc-48564ece4db4" returned: 0 in 0.275s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8962058a-e67d-4c4f-875d-52fc243e2ea6 tempest-GroupsTest-859818540 None] Lock "cinder-quobyte-cc462e88-2fee-4ef9-90dc-48564ece4db4" released by "delete_volume" :: held 0.723s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:06 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-8962058a-e67d-4c4f-875d-52fc243e2ea6 tempest-GroupsTest-859818540 None] Created reservations ['b9d12325-af8e-42dc-ac48-6719805086c9'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:45:07 devstack cinder-volume[86649]: WARNING cinder.quota [None req-8962058a-e67d-4c4f-875d-52fc243e2ea6 tempest-GroupsTest-859818540 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-157778757 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-157778757, it is now deprecated. Please use the default quota class for default quota.
Nov 05 09:45:07 devstack cinder-volume[86649]: WARNING cinder.quota [None req-8962058a-e67d-4c4f-875d-52fc243e2ea6 tempest-GroupsTest-859818540 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-157778757 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-157778757, it is now deprecated. Please use the default quota class for default quota.
Nov 05 09:45:07 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-8962058a-e67d-4c4f-875d-52fc243e2ea6 tempest-GroupsTest-859818540 None] Created reservations ['6f26a3a1-2123-48ea-b77e-52faf408a38a', '60b9f035-049b-4a96-abfb-3dd2b40d6906', '1c04fc65-2bde-443a-9222-0537f02becfd', 'd390c6ce-6991-45e5-bffe-81f7038a4678'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:45:07 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-8962058a-e67d-4c4f-875d-52fc243e2ea6 tempest-GroupsTest-859818540 None] Created reservations ['1dd0d0c4-068f-4035-bdd8-e33a0cfc3229', '10ea6cc8-d998-4bd4-b11e-b22aca66f3bb', 'b5342954-b1b8-45b6-84c5-7a395ec010dd', '605ad396-db61-43e1-92ec-5f99d85b90e9'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:45:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8962058a-e67d-4c4f-875d-52fc243e2ea6 tempest-GroupsTest-859818540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8962058a-e67d-4c4f-875d-52fc243e2ea6 tempest-GroupsTest-859818540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:07 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8962058a-e67d-4c4f-875d-52fc243e2ea6 tempest-GroupsTest-859818540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:45:07 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8962058a-e67d-4c4f-875d-52fc243e2ea6 tempest-GroupsTest-859818540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:45:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8962058a-e67d-4c4f-875d-52fc243e2ea6 tempest-GroupsTest-859818540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8962058a-e67d-4c4f-875d-52fc243e2ea6 tempest-GroupsTest-859818540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:07 devstack sudo[100301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:45:07 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:07 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8962058a-e67d-4c4f-875d-52fc243e2ea6 tempest-GroupsTest-859818540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.260s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:07 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-8962058a-e67d-4c4f-875d-52fc243e2ea6 tempest-GroupsTest-859818540 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:45:07 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-8962058a-e67d-4c4f-875d-52fc243e2ea6 tempest-GroupsTest-859818540 None] Delete group completed successfully.
Nov 05 09:45:07 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:45:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] Flow 'volume_create_manager' (428240b0-e9e8-4d1f-bc28-5daa5c7429de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:45:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d050d768-183d-450a-907e-8df28893785d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d050d768-183d-450a-907e-8df28893785d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3000926-1e4d-4212-a70a-37e0bd72a49d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1babb8bebb954a8dbb620611ad193716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:45:08Z,use_quota=True,user_id='960b320bea664d7ca3ca05b3ae3b24cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75ac4dcf-ff2a-4145-a55f-07b282780b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75ac4dcf-ff2a-4145-a55f-07b282780b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a23fa161-9ada-483e-bf82-78055b95b02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a23fa161-9ada-483e-bf82-78055b95b02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3000926-1e4d-4212-a70a-37e0bd72a49d', 'volume_name': 'volume-a3000926-1e4d-4212-a70a-37e0bd72a49d', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f737042e-22b0-4b8e-a7d4-ddd126017b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f737042e-22b0-4b8e-a7d4-ddd126017b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8291ec9c-c812-4613-aace-91be6105d839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:07 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] Volume a3000926-1e4d-4212-a70a-37e0bd72a49d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3000926-1e4d-4212-a70a-37e0bd72a49d', 'volume_size': 1}
Nov 05 09:45:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:07 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3000926-1e4d-4212-a70a-37e0bd72a49d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1babb8bebb954a8dbb620611ad193716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:45:08Z,use_quota=True,user_id='960b320bea664d7ca3ca05b3ae3b24cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:45:07 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] Creating volume a3000926-1e4d-4212-a70a-37e0bd72a49d {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:45:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:07 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:45:07 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:45:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:07 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:45:07 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:45:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a3000926-1e4d-4212-a70a-37e0bd72a49d 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:08 devstack sudo[100304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a3000926-1e4d-4212-a70a-37e0bd72a49d 1073741824
Nov 05 09:45:08 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:08 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a3000926-1e4d-4212-a70a-37e0bd72a49d 1073741824" returned: 0 in 0.486s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a3000926-1e4d-4212-a70a-37e0bd72a49d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:08 devstack sudo[100310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a3000926-1e4d-4212-a70a-37e0bd72a49d
Nov 05 09:45:08 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:08 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a3000926-1e4d-4212-a70a-37e0bd72a49d" returned: 0 in 0.307s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:08 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:45:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8291ec9c-c812-4613-aace-91be6105d839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3000926-1e4d-4212-a70a-37e0bd72a49d', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5ece718-6eb4-429f-b521-386089ab49aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:08 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] Volume volume-a3000926-1e4d-4212-a70a-37e0bd72a49d (a3000926-1e4d-4212-a70a-37e0bd72a49d): created successfully
Nov 05 09:45:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5ece718-6eb4-429f-b521-386089ab49aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] Flow 'volume_create_manager' (428240b0-e9e8-4d1f-bc28-5daa5c7429de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:45:08 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-7756cc9b-a9f9-44ce-a146-b1d4f8871a0c tempest-CinderUnicodeTest-567643213 None] Created volume successfully.
Nov 05 09:45:10 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:45:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] Flow 'volume_create_manager' (bf7481c8-e1e3-408d-abdd-b57c2d3ff7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:45:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4beb2a47-609d-4de7-916f-daed625d5329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4beb2a47-609d-4de7-916f-daed625d5329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:45:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1406910119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a701bbee-fb7d-407b-9430-f25eadf73767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1babb8bebb954a8dbb620611ad193716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:45:11Z,use_quota=True,user_id='960b320bea664d7ca3ca05b3ae3b24cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b1630f-e331-4868-a4d2-b61a5c8536d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b1630f-e331-4868-a4d2-b61a5c8536d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c95251ab-d01e-4177-ac62-f5d39b5efb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c95251ab-d01e-4177-ac62-f5d39b5efb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a701bbee-fb7d-407b-9430-f25eadf73767', 'volume_name': 'volume-a701bbee-fb7d-407b-9430-f25eadf73767', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c0b105-5e75-4c01-b54e-6820e54db7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c0b105-5e75-4c01-b54e-6820e54db7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:10 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dcc40ed-9346-4cfb-90dd-55a575640794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:10 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] Volume a701bbee-fb7d-407b-9430-f25eadf73767: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a701bbee-fb7d-407b-9430-f25eadf73767', 'volume_size': 1}
Nov 05 09:45:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:45:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1406910119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a701bbee-fb7d-407b-9430-f25eadf73767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1babb8bebb954a8dbb620611ad193716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:45:11Z,use_quota=True,user_id='960b320bea664d7ca3ca05b3ae3b24cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:45:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] Creating volume a701bbee-fb7d-407b-9430-f25eadf73767 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:45:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:45:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:45:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:45:10 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:45:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:10 devstack sudo[100322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767 1073741824
Nov 05 09:45:10 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:11 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767 1073741824" returned: 0 in 0.538s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:11 devstack sudo[100328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767
Nov 05 09:45:11 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:11 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767" returned: 0 in 0.275s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:11 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:45:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:11 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dcc40ed-9346-4cfb-90dd-55a575640794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a701bbee-fb7d-407b-9430-f25eadf73767', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:11 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (850cc476-1af4-456f-9658-466bd324df41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:11 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] Volume volume-a701bbee-fb7d-407b-9430-f25eadf73767 (a701bbee-fb7d-407b-9430-f25eadf73767): created successfully
Nov 05 09:45:11 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (850cc476-1af4-456f-9658-466bd324df41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:11 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] Flow 'volume_create_manager' (bf7481c8-e1e3-408d-abdd-b57c2d3ff7f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:45:11 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-47279a33-f4b1-4dcb-ac42-132c0a999c34 tempest-CinderUnicodeTest-567643213 None] Created volume successfully.
Nov 05 09:45:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c8618312-ec64-491a-9e1b-9693ab9644c6 tempest-CinderUnicodeTest-567643213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c8618312-ec64-491a-9e1b-9693ab9644c6 tempest-CinderUnicodeTest-567643213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c8618312-ec64-491a-9e1b-9693ab9644c6 tempest-CinderUnicodeTest-567643213 None] Creating offline snapshot 1711b2f7-7201-431c-8fb3-d2141515d36e of volume a701bbee-fb7d-407b-9430-f25eadf73767 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 09:45:13 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[57756136-5550-4c47-94de-e29cec62255b]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:45:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c8618312-ec64-491a-9e1b-9693ab9644c6 tempest-CinderUnicodeTest-567643213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:13 devstack sudo[100331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767
Nov 05 09:45:13 devstack sudo[100331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:13 devstack sudo[100331]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c8618312-ec64-491a-9e1b-9693ab9644c6 tempest-CinderUnicodeTest-567643213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767" returned: 0 in 0.404s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c8618312-ec64-491a-9e1b-9693ab9644c6 tempest-CinderUnicodeTest-567643213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767.1711b2f7-7201-431c-8fb3-d2141515d36e 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:13 devstack sudo[100336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767.1711b2f7-7201-431c-8fb3-d2141515d36e 1G
Nov 05 09:45:13 devstack sudo[100336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:13 devstack sudo[100336]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c8618312-ec64-491a-9e1b-9693ab9644c6 tempest-CinderUnicodeTest-567643213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767.1711b2f7-7201-431c-8fb3-d2141515d36e 1G" returned: 0 in 0.517s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c8618312-ec64-491a-9e1b-9693ab9644c6 tempest-CinderUnicodeTest-567643213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a701bbee-fb7d-407b-9430-f25eadf73767 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767.1711b2f7-7201-431c-8fb3-d2141515d36e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:14 devstack sudo[100342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a701bbee-fb7d-407b-9430-f25eadf73767 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767.1711b2f7-7201-431c-8fb3-d2141515d36e
Nov 05 09:45:14 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:14 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-32e46d07-1ed6-44e7-b49b-19805b656611 tempest-GroupsV320Test-1726417364 None] Group tempest-GroupsV320Test-Group-556819076: creating
Nov 05 09:45:14 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c8618312-ec64-491a-9e1b-9693ab9644c6 tempest-CinderUnicodeTest-567643213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a701bbee-fb7d-407b-9430-f25eadf73767 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767.1711b2f7-7201-431c-8fb3-d2141515d36e" returned: 0 in 0.332s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:14 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-c8618312-ec64-491a-9e1b-9693ab9644c6 tempest-CinderUnicodeTest-567643213 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767.1711b2f7-7201-431c-8fb3-d2141515d36e is being set with open permissions: ugo+rw
Nov 05 09:45:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c8618312-ec64-491a-9e1b-9693ab9644c6 tempest-CinderUnicodeTest-567643213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767.1711b2f7-7201-431c-8fb3-d2141515d36e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:14 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-32e46d07-1ed6-44e7-b49b-19805b656611 tempest-GroupsV320Test-1726417364 None] Group tempest-GroupsV320Test-Group-556819076: created successfully
Nov 05 09:45:14 devstack sudo[100347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767.1711b2f7-7201-431c-8fb3-d2141515d36e
Nov 05 09:45:14 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:14 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-32e46d07-1ed6-44e7-b49b-19805b656611 tempest-GroupsV320Test-1726417364 None] Create group completed successfully.
Nov 05 09:45:14 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c8618312-ec64-491a-9e1b-9693ab9644c6 tempest-CinderUnicodeTest-567643213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767.1711b2f7-7201-431c-8fb3-d2141515d36e" returned: 0 in 0.249s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c8618312-ec64-491a-9e1b-9693ab9644c6 tempest-CinderUnicodeTest-567643213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:14 devstack sudo[100350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767.info
Nov 05 09:45:14 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:14 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c8618312-ec64-491a-9e1b-9693ab9644c6 tempest-CinderUnicodeTest-567643213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767.info" returned: 0 in 0.266s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:14 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-c8618312-ec64-491a-9e1b-9693ab9644c6 tempest-CinderUnicodeTest-567643213 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767.info is being set with open permissions: ugo+rw
Nov 05 09:45:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c8618312-ec64-491a-9e1b-9693ab9644c6 tempest-CinderUnicodeTest-567643213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:14 devstack sudo[100353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767.info
Nov 05 09:45:14 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:15 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c8618312-ec64-491a-9e1b-9693ab9644c6 tempest-CinderUnicodeTest-567643213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767.info" returned: 0 in 0.289s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c8618312-ec64-491a-9e1b-9693ab9644c6 tempest-CinderUnicodeTest-567643213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.160s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:15 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c8618312-ec64-491a-9e1b-9693ab9644c6 tempest-CinderUnicodeTest-567643213 None] Create snapshot completed successfully
Nov 05 09:45:15 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-987f6e35-53c0-4587-bd11-e4551bfce923 tempest-GroupsV320Test-1726417364 None] Created reservations ['24d15624-96b2-4e6b-bab5-76f691b18e75'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:45:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-987f6e35-53c0-4587-bd11-e4551bfce923 tempest-GroupsV320Test-1726417364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-987f6e35-53c0-4587-bd11-e4551bfce923 tempest-GroupsV320Test-1726417364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-987f6e35-53c0-4587-bd11-e4551bfce923 tempest-GroupsV320Test-1726417364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:45:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-987f6e35-53c0-4587-bd11-e4551bfce923 tempest-GroupsV320Test-1726417364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:45:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-987f6e35-53c0-4587-bd11-e4551bfce923 tempest-GroupsV320Test-1726417364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-987f6e35-53c0-4587-bd11-e4551bfce923 tempest-GroupsV320Test-1726417364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:15 devstack sudo[100356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:45:15 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:16 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-987f6e35-53c0-4587-bd11-e4551bfce923 tempest-GroupsV320Test-1726417364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.284s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:16 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-987f6e35-53c0-4587-bd11-e4551bfce923 tempest-GroupsV320Test-1726417364 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:45:16 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-987f6e35-53c0-4587-bd11-e4551bfce923 tempest-GroupsV320Test-1726417364 None] Delete group completed successfully.
Nov 05 09:45:16 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7d42a823-6016-4706-8e7e-33139900adf8 tempest-CinderUnicodeTest-567643213 None] Acquiring lock "cinder-1711b2f7-7201-431c-8fb3-d2141515d36e-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:16 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7d42a823-6016-4706-8e7e-33139900adf8 tempest-CinderUnicodeTest-567643213 None] Lock "cinder-1711b2f7-7201-431c-8fb3-d2141515d36e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:16 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7d42a823-6016-4706-8e7e-33139900adf8 tempest-CinderUnicodeTest-567643213 None] Acquiring lock "cinder-quobyte-a701bbee-fb7d-407b-9430-f25eadf73767" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:16 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7d42a823-6016-4706-8e7e-33139900adf8 tempest-CinderUnicodeTest-567643213 None] Lock "cinder-quobyte-a701bbee-fb7d-407b-9430-f25eadf73767" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:16 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7d42a823-6016-4706-8e7e-33139900adf8 tempest-CinderUnicodeTest-567643213 None] Acquiring lock "cinder-quobyte-1711b2f7-7201-431c-8fb3-d2141515d36e" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:16 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7d42a823-6016-4706-8e7e-33139900adf8 tempest-CinderUnicodeTest-567643213 None] Lock "cinder-quobyte-1711b2f7-7201-431c-8fb3-d2141515d36e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-7d42a823-6016-4706-8e7e-33139900adf8 tempest-CinderUnicodeTest-567643213 None] Deleting offline snapshot 1711b2f7-7201-431c-8fb3-d2141515d36e of volume a701bbee-fb7d-407b-9430-f25eadf73767 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 09:45:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-7d42a823-6016-4706-8e7e-33139900adf8 tempest-CinderUnicodeTest-567643213 None] snapshot_file for this snap is: volume-a701bbee-fb7d-407b-9430-f25eadf73767.1711b2f7-7201-431c-8fb3-d2141515d36e {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 09:45:16 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ff6b19-d0ad-4796-b5c5-de5538961b1d]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:45:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d42a823-6016-4706-8e7e-33139900adf8 tempest-CinderUnicodeTest-567643213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767.1711b2f7-7201-431c-8fb3-d2141515d36e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:16 devstack sudo[100359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767.1711b2f7-7201-431c-8fb3-d2141515d36e
Nov 05 09:45:16 devstack sudo[100359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:16 devstack sudo[100359]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d42a823-6016-4706-8e7e-33139900adf8 tempest-CinderUnicodeTest-567643213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767.1711b2f7-7201-431c-8fb3-d2141515d36e" returned: 0 in 0.381s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-7d42a823-6016-4706-8e7e-33139900adf8 tempest-CinderUnicodeTest-567643213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a701bbee-fb7d-407b-9430-f25eadf73767(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:45:16 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f49a229-54ff-4d05-85d6-ba0cb549d7be]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:45:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d42a823-6016-4706-8e7e-33139900adf8 tempest-CinderUnicodeTest-567643213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:16 devstack sudo[100364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767
Nov 05 09:45:16 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:17 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d42a823-6016-4706-8e7e-33139900adf8 tempest-CinderUnicodeTest-567643213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767" returned: 0 in 0.402s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d42a823-6016-4706-8e7e-33139900adf8 tempest-CinderUnicodeTest-567643213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767.1711b2f7-7201-431c-8fb3-d2141515d36e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:17 devstack sudo[100369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767.1711b2f7-7201-431c-8fb3-d2141515d36e
Nov 05 09:45:17 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:17 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d42a823-6016-4706-8e7e-33139900adf8 tempest-CinderUnicodeTest-567643213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767.1711b2f7-7201-431c-8fb3-d2141515d36e" returned: 0 in 0.363s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d42a823-6016-4706-8e7e-33139900adf8 tempest-CinderUnicodeTest-567643213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767.1711b2f7-7201-431c-8fb3-d2141515d36e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:17 devstack sudo[100375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767.1711b2f7-7201-431c-8fb3-d2141515d36e
Nov 05 09:45:17 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:17 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d42a823-6016-4706-8e7e-33139900adf8 tempest-CinderUnicodeTest-567643213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767.1711b2f7-7201-431c-8fb3-d2141515d36e" returned: 0 in 0.292s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7d42a823-6016-4706-8e7e-33139900adf8 tempest-CinderUnicodeTest-567643213 None] Lock "cinder-quobyte-1711b2f7-7201-431c-8fb3-d2141515d36e" released by "_delete_snapshot" :: held 1.568s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7d42a823-6016-4706-8e7e-33139900adf8 tempest-CinderUnicodeTest-567643213 None] Lock "cinder-quobyte-a701bbee-fb7d-407b-9430-f25eadf73767" released by "delete_snapshot" :: held 1.592s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:17 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-7d42a823-6016-4706-8e7e-33139900adf8 tempest-CinderUnicodeTest-567643213 None] Created reservations ['28998734-fad9-4e74-8b0a-87b956bc15e2', '6d2d3c07-1330-4f0e-a4c1-4c5b212e8df3', '360c60fa-fa0d-4746-83a2-e01169343205', '9a27ea90-251e-4b83-b45d-874d9f1cab35'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:45:17 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-7d42a823-6016-4706-8e7e-33139900adf8 tempest-CinderUnicodeTest-567643213 None] Delete snapshot completed successfully.
Nov 05 09:45:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7d42a823-6016-4706-8e7e-33139900adf8 tempest-CinderUnicodeTest-567643213 None] Lock "cinder-1711b2f7-7201-431c-8fb3-d2141515d36e-delete_snapshot" released by "delete_snapshot" :: held 1.741s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-79ecc056-1760-41ef-9168-0de2ea0186c9 tempest-CinderUnicodeTest-567643213 None] Acquiring lock "cinder-a701bbee-fb7d-407b-9430-f25eadf73767-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-79ecc056-1760-41ef-9168-0de2ea0186c9 tempest-CinderUnicodeTest-567643213 None] Lock "cinder-a701bbee-fb7d-407b-9430-f25eadf73767-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-79ecc056-1760-41ef-9168-0de2ea0186c9 tempest-CinderUnicodeTest-567643213 None] Acquiring lock "cinder-quobyte-a701bbee-fb7d-407b-9430-f25eadf73767" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-79ecc056-1760-41ef-9168-0de2ea0186c9 tempest-CinderUnicodeTest-567643213 None] Lock "cinder-quobyte-a701bbee-fb7d-407b-9430-f25eadf73767" acquired by "delete_volume" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:18 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[a069a2ac-b4ac-4b80-aa85-3e98a92bb7f3]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:45:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-79ecc056-1760-41ef-9168-0de2ea0186c9 tempest-CinderUnicodeTest-567643213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:18 devstack sudo[100378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767
Nov 05 09:45:18 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:18 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-79ecc056-1760-41ef-9168-0de2ea0186c9 tempest-CinderUnicodeTest-567643213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767" returned: 0 in 0.424s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-79ecc056-1760-41ef-9168-0de2ea0186c9 tempest-CinderUnicodeTest-567643213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:19 devstack sudo[100383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767
Nov 05 09:45:19 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:19 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-79ecc056-1760-41ef-9168-0de2ea0186c9 tempest-CinderUnicodeTest-567643213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a701bbee-fb7d-407b-9430-f25eadf73767" returned: 0 in 0.306s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-79ecc056-1760-41ef-9168-0de2ea0186c9 tempest-CinderUnicodeTest-567643213 None] Lock "cinder-quobyte-a701bbee-fb7d-407b-9430-f25eadf73767" released by "delete_volume" :: held 0.801s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:19 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-79ecc056-1760-41ef-9168-0de2ea0186c9 tempest-CinderUnicodeTest-567643213 None] Created reservations ['4884a415-eb07-45f2-8434-aa7109de6d7f', '227c5f74-2993-4279-9656-1eb45e3eb7af', '005b14e5-ee85-4e77-bc31-ed9235880f45', '4ff1b773-3cec-4334-bb4f-a4586c3ad7c3'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:45:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-79ecc056-1760-41ef-9168-0de2ea0186c9 tempest-CinderUnicodeTest-567643213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-79ecc056-1760-41ef-9168-0de2ea0186c9 tempest-CinderUnicodeTest-567643213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-79ecc056-1760-41ef-9168-0de2ea0186c9 tempest-CinderUnicodeTest-567643213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:45:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-79ecc056-1760-41ef-9168-0de2ea0186c9 tempest-CinderUnicodeTest-567643213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:45:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-79ecc056-1760-41ef-9168-0de2ea0186c9 tempest-CinderUnicodeTest-567643213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-79ecc056-1760-41ef-9168-0de2ea0186c9 tempest-CinderUnicodeTest-567643213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:19 devstack sudo[100387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:45:19 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3519cc0e-3c08-4623-a235-58bfba6bac89 tempest-CinderUnicodeTest-567643213 None] Acquiring lock "cinder-a3000926-1e4d-4212-a70a-37e0bd72a49d-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3519cc0e-3c08-4623-a235-58bfba6bac89 tempest-CinderUnicodeTest-567643213 None] Lock "cinder-a3000926-1e4d-4212-a70a-37e0bd72a49d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3519cc0e-3c08-4623-a235-58bfba6bac89 tempest-CinderUnicodeTest-567643213 None] Acquiring lock "cinder-quobyte-a3000926-1e4d-4212-a70a-37e0bd72a49d" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:19 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3519cc0e-3c08-4623-a235-58bfba6bac89 tempest-CinderUnicodeTest-567643213 None] Lock "cinder-quobyte-a3000926-1e4d-4212-a70a-37e0bd72a49d" acquired by "delete_volume" :: waited 0.026s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-79ecc056-1760-41ef-9168-0de2ea0186c9 tempest-CinderUnicodeTest-567643213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.335s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:19 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-79ecc056-1760-41ef-9168-0de2ea0186c9 tempest-CinderUnicodeTest-567643213 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:45:19 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-79ecc056-1760-41ef-9168-0de2ea0186c9 tempest-CinderUnicodeTest-567643213 None] Deleted volume successfully.
Nov 05 09:45:19 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5f40de-be41-40a4-8516-f6f6fdba8add]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:45:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3519cc0e-3c08-4623-a235-58bfba6bac89 tempest-CinderUnicodeTest-567643213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a3000926-1e4d-4212-a70a-37e0bd72a49d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-79ecc056-1760-41ef-9168-0de2ea0186c9 tempest-CinderUnicodeTest-567643213 None] Lock "cinder-a701bbee-fb7d-407b-9430-f25eadf73767-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:19 devstack sudo[100391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a3000926-1e4d-4212-a70a-37e0bd72a49d
Nov 05 09:45:19 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:20 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3519cc0e-3c08-4623-a235-58bfba6bac89 tempest-CinderUnicodeTest-567643213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a3000926-1e4d-4212-a70a-37e0bd72a49d" returned: 0 in 0.433s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3519cc0e-3c08-4623-a235-58bfba6bac89 tempest-CinderUnicodeTest-567643213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a3000926-1e4d-4212-a70a-37e0bd72a49d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:20 devstack sudo[100396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a3000926-1e4d-4212-a70a-37e0bd72a49d
Nov 05 09:45:20 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:20 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3519cc0e-3c08-4623-a235-58bfba6bac89 tempest-CinderUnicodeTest-567643213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a3000926-1e4d-4212-a70a-37e0bd72a49d" returned: 0 in 0.296s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3519cc0e-3c08-4623-a235-58bfba6bac89 tempest-CinderUnicodeTest-567643213 None] Lock "cinder-quobyte-a3000926-1e4d-4212-a70a-37e0bd72a49d" released by "delete_volume" :: held 0.783s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:20 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-3519cc0e-3c08-4623-a235-58bfba6bac89 tempest-CinderUnicodeTest-567643213 None] Created reservations ['6cb68c7f-cec3-45f1-9d67-2cec10d1feec', '885af077-7d7a-4e24-9e15-bc246d1def66', 'bf2e1543-9174-40b5-9384-342b01d509be', 'be92d120-e083-484e-bcde-8c23af6e6dc4'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:45:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3519cc0e-3c08-4623-a235-58bfba6bac89 tempest-CinderUnicodeTest-567643213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3519cc0e-3c08-4623-a235-58bfba6bac89 tempest-CinderUnicodeTest-567643213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3519cc0e-3c08-4623-a235-58bfba6bac89 tempest-CinderUnicodeTest-567643213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:45:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3519cc0e-3c08-4623-a235-58bfba6bac89 tempest-CinderUnicodeTest-567643213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:45:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3519cc0e-3c08-4623-a235-58bfba6bac89 tempest-CinderUnicodeTest-567643213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3519cc0e-3c08-4623-a235-58bfba6bac89 tempest-CinderUnicodeTest-567643213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:20 devstack sudo[100399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:45:20 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:20 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3519cc0e-3c08-4623-a235-58bfba6bac89 tempest-CinderUnicodeTest-567643213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.266s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:20 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-3519cc0e-3c08-4623-a235-58bfba6bac89 tempest-CinderUnicodeTest-567643213 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:45:20 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-3519cc0e-3c08-4623-a235-58bfba6bac89 tempest-CinderUnicodeTest-567643213 None] Deleted volume successfully.
Nov 05 09:45:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3519cc0e-3c08-4623-a235-58bfba6bac89 tempest-CinderUnicodeTest-567643213 None] Lock "cinder-a3000926-1e4d-4212-a70a-37e0bd72a49d-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:23 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:45:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] Flow 'volume_create_manager' (b976e5c8-72a6-49b1-8d43-0ea719945692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:45:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d795fb2-52ec-4650-a275-447afac5ccf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d795fb2-52ec-4650-a275-447afac5ccf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-358195146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2333b190-6c94-48ad-beab-0b2b9b0048f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38ee67e2c89542b197d1edf25eba4157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:45:24Z,use_quota=True,user_id='8639bb75b8434c41b86815fba5c1ef5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f55b0ab0-51c7-4a08-9747-aaca976d15cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f55b0ab0-51c7-4a08-9747-aaca976d15cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de4a7e03-d425-4513-b08a-224b2c47a8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de4a7e03-d425-4513-b08a-224b2c47a8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2333b190-6c94-48ad-beab-0b2b9b0048f7', 'volume_name': 'volume-2333b190-6c94-48ad-beab-0b2b9b0048f7', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cca0f98-1037-4079-b491-4957c6ba18bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cca0f98-1037-4079-b491-4957c6ba18bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e057fe-fc1f-429f-b564-0231f150a012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:23 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] Volume 2333b190-6c94-48ad-beab-0b2b9b0048f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2333b190-6c94-48ad-beab-0b2b9b0048f7', 'volume_size': 1}
Nov 05 09:45:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-358195146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2333b190-6c94-48ad-beab-0b2b9b0048f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38ee67e2c89542b197d1edf25eba4157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:45:24Z,use_quota=True,user_id='8639bb75b8434c41b86815fba5c1ef5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:45:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] Creating volume 2333b190-6c94-48ad-beab-0b2b9b0048f7 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:45:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:45:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:45:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:45:23 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:45:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:23 devstack sudo[100402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7 1073741824
Nov 05 09:45:23 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:24 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7 1073741824" returned: 0 in 0.441s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:24 devstack sudo[100408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7
Nov 05 09:45:24 devstack sudo[100408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:24 devstack sudo[100408]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7" returned: 0 in 0.268s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:45:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e057fe-fc1f-429f-b564-0231f150a012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2333b190-6c94-48ad-beab-0b2b9b0048f7', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (725b20bf-29c7-40e9-a9c8-143b82e45a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:24 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] Volume volume-2333b190-6c94-48ad-beab-0b2b9b0048f7 (2333b190-6c94-48ad-beab-0b2b9b0048f7): created successfully
Nov 05 09:45:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (725b20bf-29c7-40e9-a9c8-143b82e45a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] Flow 'volume_create_manager' (b976e5c8-72a6-49b1-8d43-0ea719945692) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:45:24 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b50e14db-c32f-4599-8f3b-78013234bcf9 tempest-SnapshotsActionsTest-1440055386 None] Created volume successfully.
Nov 05 09:45:24 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:45:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] Flow 'volume_create_manager' (065208dc-852f-4d00-9e2c-fdaaa513122d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:45:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b685460-a1e9-4ee3-8575-1b7a5bffeb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b685460-a1e9-4ee3-8575-1b7a5bffeb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-389360599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1482a1a-8937-4b0c-9e8c-e4c1b8ea9646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8933accb8eb473884255e7d23bc46e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:45:25Z,use_quota=True,user_id='85df128c38624f8faeec9e9060320a00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c54ac547-56b3-4eb0-b9d1-e05f162cc239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c54ac547-56b3-4eb0-b9d1-e05f162cc239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ee6521b-7ffa-4dcb-85ab-cb40b52b1b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ee6521b-7ffa-4dcb-85ab-cb40b52b1b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1482a1a-8937-4b0c-9e8c-e4c1b8ea9646', 'volume_name': 'volume-e1482a1a-8937-4b0c-9e8c-e4c1b8ea9646', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (830d2d7d-187e-4b69-ae33-a16dcb9b843a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (830d2d7d-187e-4b69-ae33-a16dcb9b843a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b61e6fb4-2346-45b9-9efd-c75a3ecadbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:24 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] Volume e1482a1a-8937-4b0c-9e8c-e4c1b8ea9646: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1482a1a-8937-4b0c-9e8c-e4c1b8ea9646', 'volume_size': 1}
Nov 05 09:45:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-389360599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1482a1a-8937-4b0c-9e8c-e4c1b8ea9646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8933accb8eb473884255e7d23bc46e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:45:25Z,use_quota=True,user_id='85df128c38624f8faeec9e9060320a00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:45:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] Creating volume e1482a1a-8937-4b0c-9e8c-e4c1b8ea9646 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:45:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:45:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:45:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:45:24 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:45:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e1482a1a-8937-4b0c-9e8c-e4c1b8ea9646 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:24 devstack sudo[100412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e1482a1a-8937-4b0c-9e8c-e4c1b8ea9646 1073741824
Nov 05 09:45:24 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9ff5da53-0b78-4ee9-9217-0ac6973cfb09 tempest-SnapshotsActionsTest-1440055386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:25 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e1482a1a-8937-4b0c-9e8c-e4c1b8ea9646 1073741824" returned: 0 in 0.492s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e1482a1a-8937-4b0c-9e8c-e4c1b8ea9646 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:25 devstack sudo[100418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e1482a1a-8937-4b0c-9e8c-e4c1b8ea9646
Nov 05 09:45:25 devstack sudo[100418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:25 devstack sudo[100418]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e1482a1a-8937-4b0c-9e8c-e4c1b8ea9646" returned: 0 in 0.253s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:45:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9ff5da53-0b78-4ee9-9217-0ac6973cfb09 tempest-SnapshotsActionsTest-1440055386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.551s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b61e6fb4-2346-45b9-9efd-c75a3ecadbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1482a1a-8937-4b0c-9e8c-e4c1b8ea9646', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (503ae53f-1701-4a54-9510-892076f47a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-9ff5da53-0b78-4ee9-9217-0ac6973cfb09 tempest-SnapshotsActionsTest-1440055386 None] Creating offline snapshot 31f2ffde-7b37-4f18-afb1-6fce5c13e609 of volume 2333b190-6c94-48ad-beab-0b2b9b0048f7 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 09:45:25 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] Volume volume-e1482a1a-8937-4b0c-9e8c-e4c1b8ea9646 (e1482a1a-8937-4b0c-9e8c-e4c1b8ea9646): created successfully
Nov 05 09:45:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (503ae53f-1701-4a54-9510-892076f47a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] Flow 'volume_create_manager' (065208dc-852f-4d00-9e2c-fdaaa513122d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:45:25 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c41e249-4dd1-4370-8acd-9674c6145c7c]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:45:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9ff5da53-0b78-4ee9-9217-0ac6973cfb09 tempest-SnapshotsActionsTest-1440055386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:25 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-4c6eacfc-d50d-4e32-b478-08d086afee1c tempest-ProjectReaderTests-272895753 None] Created volume successfully.
Nov 05 09:45:25 devstack sudo[100421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7
Nov 05 09:45:25 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:26 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9ff5da53-0b78-4ee9-9217-0ac6973cfb09 tempest-SnapshotsActionsTest-1440055386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7" returned: 0 in 0.388s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9ff5da53-0b78-4ee9-9217-0ac6973cfb09 tempest-SnapshotsActionsTest-1440055386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:26 devstack sudo[100426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609 1G
Nov 05 09:45:26 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:26 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9ff5da53-0b78-4ee9-9217-0ac6973cfb09 tempest-SnapshotsActionsTest-1440055386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609 1G" returned: 0 in 0.405s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9ff5da53-0b78-4ee9-9217-0ac6973cfb09 tempest-SnapshotsActionsTest-1440055386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2333b190-6c94-48ad-beab-0b2b9b0048f7 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:26 devstack sudo[100431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2333b190-6c94-48ad-beab-0b2b9b0048f7 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609
Nov 05 09:45:26 devstack sudo[100431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:26 devstack sudo[100431]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9ff5da53-0b78-4ee9-9217-0ac6973cfb09 tempest-SnapshotsActionsTest-1440055386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2333b190-6c94-48ad-beab-0b2b9b0048f7 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609" returned: 0 in 0.313s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:26 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-9ff5da53-0b78-4ee9-9217-0ac6973cfb09 tempest-SnapshotsActionsTest-1440055386 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609 is being set with open permissions: ugo+rw
Nov 05 09:45:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9ff5da53-0b78-4ee9-9217-0ac6973cfb09 tempest-SnapshotsActionsTest-1440055386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:26 devstack sudo[100436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609
Nov 05 09:45:26 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a890dfc0-3915-42b5-a8b1-eff49bc5643c tempest-ProjectReaderTests-272895753 None] Acquiring lock "cinder-e1482a1a-8937-4b0c-9e8c-e4c1b8ea9646-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a890dfc0-3915-42b5-a8b1-eff49bc5643c tempest-ProjectReaderTests-272895753 None] Lock "cinder-e1482a1a-8937-4b0c-9e8c-e4c1b8ea9646-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a890dfc0-3915-42b5-a8b1-eff49bc5643c tempest-ProjectReaderTests-272895753 None] Acquiring lock "cinder-quobyte-e1482a1a-8937-4b0c-9e8c-e4c1b8ea9646" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a890dfc0-3915-42b5-a8b1-eff49bc5643c tempest-ProjectReaderTests-272895753 None] Lock "cinder-quobyte-e1482a1a-8937-4b0c-9e8c-e4c1b8ea9646" acquired by "delete_volume" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:27 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9ff5da53-0b78-4ee9-9217-0ac6973cfb09 tempest-SnapshotsActionsTest-1440055386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609" returned: 0 in 0.290s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:27 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[8134bf9f-8c84-458e-8191-2dcc4e953267]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:45:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a890dfc0-3915-42b5-a8b1-eff49bc5643c tempest-ProjectReaderTests-272895753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e1482a1a-8937-4b0c-9e8c-e4c1b8ea9646 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9ff5da53-0b78-4ee9-9217-0ac6973cfb09 tempest-SnapshotsActionsTest-1440055386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:27 devstack sudo[100440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.info
Nov 05 09:45:27 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:27 devstack sudo[100439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e1482a1a-8937-4b0c-9e8c-e4c1b8ea9646
Nov 05 09:45:27 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:27 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9ff5da53-0b78-4ee9-9217-0ac6973cfb09 tempest-SnapshotsActionsTest-1440055386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.info" returned: 0 in 0.273s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:27 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-9ff5da53-0b78-4ee9-9217-0ac6973cfb09 tempest-SnapshotsActionsTest-1440055386 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.info is being set with open permissions: ugo+rw
Nov 05 09:45:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9ff5da53-0b78-4ee9-9217-0ac6973cfb09 tempest-SnapshotsActionsTest-1440055386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:27 devstack sudo[100446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.info
Nov 05 09:45:27 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:27 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a890dfc0-3915-42b5-a8b1-eff49bc5643c tempest-ProjectReaderTests-272895753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e1482a1a-8937-4b0c-9e8c-e4c1b8ea9646" returned: 0 in 0.396s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a890dfc0-3915-42b5-a8b1-eff49bc5643c tempest-ProjectReaderTests-272895753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e1482a1a-8937-4b0c-9e8c-e4c1b8ea9646 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:27 devstack sudo[100449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e1482a1a-8937-4b0c-9e8c-e4c1b8ea9646
Nov 05 09:45:27 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:27 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9ff5da53-0b78-4ee9-9217-0ac6973cfb09 tempest-SnapshotsActionsTest-1440055386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.info" returned: 0 in 0.265s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9ff5da53-0b78-4ee9-9217-0ac6973cfb09 tempest-SnapshotsActionsTest-1440055386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.077s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:27 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-9ff5da53-0b78-4ee9-9217-0ac6973cfb09 tempest-SnapshotsActionsTest-1440055386 None] Create snapshot completed successfully
Nov 05 09:45:27 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a890dfc0-3915-42b5-a8b1-eff49bc5643c tempest-ProjectReaderTests-272895753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e1482a1a-8937-4b0c-9e8c-e4c1b8ea9646" returned: 0 in 0.280s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a890dfc0-3915-42b5-a8b1-eff49bc5643c tempest-ProjectReaderTests-272895753 None] Lock "cinder-quobyte-e1482a1a-8937-4b0c-9e8c-e4c1b8ea9646" released by "delete_volume" :: held 0.725s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:27 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-a890dfc0-3915-42b5-a8b1-eff49bc5643c tempest-ProjectReaderTests-272895753 None] Created reservations ['6dde68e9-4261-4b59-8a63-0ac730921607', '82e6410e-e0ca-4ad6-8f8b-bb22e8d5026a', '4f342beb-ba8b-4743-bbf7-2953782f7fbe', '88fc3235-e2f7-47aa-bd0c-e1d0e064a59a'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:45:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a890dfc0-3915-42b5-a8b1-eff49bc5643c tempest-ProjectReaderTests-272895753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a890dfc0-3915-42b5-a8b1-eff49bc5643c tempest-ProjectReaderTests-272895753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a890dfc0-3915-42b5-a8b1-eff49bc5643c tempest-ProjectReaderTests-272895753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:45:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a890dfc0-3915-42b5-a8b1-eff49bc5643c tempest-ProjectReaderTests-272895753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:45:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a890dfc0-3915-42b5-a8b1-eff49bc5643c tempest-ProjectReaderTests-272895753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a890dfc0-3915-42b5-a8b1-eff49bc5643c tempest-ProjectReaderTests-272895753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:28 devstack sudo[100455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:45:28 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:28 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a890dfc0-3915-42b5-a8b1-eff49bc5643c tempest-ProjectReaderTests-272895753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.305s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:28 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-a890dfc0-3915-42b5-a8b1-eff49bc5643c tempest-ProjectReaderTests-272895753 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:45:28 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-a890dfc0-3915-42b5-a8b1-eff49bc5643c tempest-ProjectReaderTests-272895753 None] Deleted volume successfully.
Nov 05 09:45:28 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a890dfc0-3915-42b5-a8b1-eff49bc5643c tempest-ProjectReaderTests-272895753 None] Lock "cinder-e1482a1a-8937-4b0c-9e8c-e4c1b8ea9646-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:28 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:45:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] Flow 'volume_create_manager' (b80619cb-7ea4-45a8-b8ab-2d95c3c6df73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:45:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21a22f51-3820-4e0d-b0a7-4d1b4bf7f5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21a22f51-3820-4e0d-b0a7-4d1b4bf7f5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2032456642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae67c3c8-9fc4-4752-84a9-886ddf1aba4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8933accb8eb473884255e7d23bc46e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:45:29Z,use_quota=True,user_id='85df128c38624f8faeec9e9060320a00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91dd85dc-cf85-4d72-8c1c-c677460f4998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91dd85dc-cf85-4d72-8c1c-c677460f4998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b42850a-866b-40cd-aece-a012f0978d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b42850a-866b-40cd-aece-a012f0978d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae67c3c8-9fc4-4752-84a9-886ddf1aba4d', 'volume_name': 'volume-ae67c3c8-9fc4-4752-84a9-886ddf1aba4d', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d76ea26-8b13-4815-8108-ce72af961091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d76ea26-8b13-4815-8108-ce72af961091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f9b62fe-474b-4a00-95b5-33226d250007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:28 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] Volume ae67c3c8-9fc4-4752-84a9-886ddf1aba4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae67c3c8-9fc4-4752-84a9-886ddf1aba4d', 'volume_size': 1}
Nov 05 09:45:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2032456642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae67c3c8-9fc4-4752-84a9-886ddf1aba4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8933accb8eb473884255e7d23bc46e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:45:29Z,use_quota=True,user_id='85df128c38624f8faeec9e9060320a00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:45:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] Creating volume ae67c3c8-9fc4-4752-84a9-886ddf1aba4d {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:45:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:45:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:45:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:45:28 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:45:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ae67c3c8-9fc4-4752-84a9-886ddf1aba4d 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:28 devstack sudo[100458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ae67c3c8-9fc4-4752-84a9-886ddf1aba4d 1073741824
Nov 05 09:45:28 devstack sudo[100458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6b91bc3f-c3d7-4b98-b017-998f04d027cb tempest-SnapshotsActionsTest-1440055386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:29 devstack sudo[100458]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ae67c3c8-9fc4-4752-84a9-886ddf1aba4d 1073741824" returned: 0 in 0.439s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ae67c3c8-9fc4-4752-84a9-886ddf1aba4d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:29 devstack sudo[100465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ae67c3c8-9fc4-4752-84a9-886ddf1aba4d
Nov 05 09:45:29 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:29 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ae67c3c8-9fc4-4752-84a9-886ddf1aba4d" returned: 0 in 0.260s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:45:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6b91bc3f-c3d7-4b98-b017-998f04d027cb tempest-SnapshotsActionsTest-1440055386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.691s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f9b62fe-474b-4a00-95b5-33226d250007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae67c3c8-9fc4-4752-84a9-886ddf1aba4d', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e267227b-694d-44bc-b32e-b3bca4fd1ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-6b91bc3f-c3d7-4b98-b017-998f04d027cb tempest-SnapshotsActionsTest-1440055386 None] Creating offline snapshot 83648238-9125-4109-ab09-3ee82cdea8db of volume 2333b190-6c94-48ad-beab-0b2b9b0048f7 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 09:45:29 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] Volume volume-ae67c3c8-9fc4-4752-84a9-886ddf1aba4d (ae67c3c8-9fc4-4752-84a9-886ddf1aba4d): created successfully
Nov 05 09:45:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e267227b-694d-44bc-b32e-b3bca4fd1ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] Flow 'volume_create_manager' (b80619cb-7ea4-45a8-b8ab-2d95c3c6df73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:45:29 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[396e17e3-d43a-4e56-8bdd-796c2bf94ada]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:45:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6b91bc3f-c3d7-4b98-b017-998f04d027cb tempest-SnapshotsActionsTest-1440055386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:29 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-94e83c84-1657-4b13-b623-84d966f4447b tempest-ProjectReaderTests-272895753 None] Created volume successfully.
Nov 05 09:45:29 devstack sudo[100468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609
Nov 05 09:45:29 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:30 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6b91bc3f-c3d7-4b98-b017-998f04d027cb tempest-SnapshotsActionsTest-1440055386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609" returned: 0 in 0.391s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-6b91bc3f-c3d7-4b98-b017-998f04d027cb tempest-SnapshotsActionsTest-1440055386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2333b190-6c94-48ad-beab-0b2b9b0048f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:45:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6b91bc3f-c3d7-4b98-b017-998f04d027cb tempest-SnapshotsActionsTest-1440055386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.83648238-9125-4109-ab09-3ee82cdea8db 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:30 devstack sudo[100473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.83648238-9125-4109-ab09-3ee82cdea8db 1G
Nov 05 09:45:30 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:30 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6b91bc3f-c3d7-4b98-b017-998f04d027cb tempest-SnapshotsActionsTest-1440055386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.83648238-9125-4109-ab09-3ee82cdea8db 1G" returned: 0 in 0.425s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6b91bc3f-c3d7-4b98-b017-998f04d027cb tempest-SnapshotsActionsTest-1440055386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.83648238-9125-4109-ab09-3ee82cdea8db {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:30 devstack sudo[100479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.83648238-9125-4109-ab09-3ee82cdea8db
Nov 05 09:45:30 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:30 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6b91bc3f-c3d7-4b98-b017-998f04d027cb tempest-SnapshotsActionsTest-1440055386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.83648238-9125-4109-ab09-3ee82cdea8db" returned: 0 in 0.300s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:30 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-6b91bc3f-c3d7-4b98-b017-998f04d027cb tempest-SnapshotsActionsTest-1440055386 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.83648238-9125-4109-ab09-3ee82cdea8db is being set with open permissions: ugo+rw
Nov 05 09:45:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6b91bc3f-c3d7-4b98-b017-998f04d027cb tempest-SnapshotsActionsTest-1440055386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.83648238-9125-4109-ab09-3ee82cdea8db {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:30 devstack sudo[100485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.83648238-9125-4109-ab09-3ee82cdea8db
Nov 05 09:45:30 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-80020ce6-21b1-456a-bd68-8aa7dd2a2dd9 tempest-ProjectReaderTests-272895753 None] Acquiring lock "cinder-ae67c3c8-9fc4-4752-84a9-886ddf1aba4d-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-80020ce6-21b1-456a-bd68-8aa7dd2a2dd9 tempest-ProjectReaderTests-272895753 None] Lock "cinder-ae67c3c8-9fc4-4752-84a9-886ddf1aba4d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-80020ce6-21b1-456a-bd68-8aa7dd2a2dd9 tempest-ProjectReaderTests-272895753 None] Acquiring lock "cinder-quobyte-ae67c3c8-9fc4-4752-84a9-886ddf1aba4d" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-80020ce6-21b1-456a-bd68-8aa7dd2a2dd9 tempest-ProjectReaderTests-272895753 None] Lock "cinder-quobyte-ae67c3c8-9fc4-4752-84a9-886ddf1aba4d" acquired by "delete_volume" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:31 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef9bd54-b166-45c2-9c85-4e4e3163585b]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:45:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-80020ce6-21b1-456a-bd68-8aa7dd2a2dd9 tempest-ProjectReaderTests-272895753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ae67c3c8-9fc4-4752-84a9-886ddf1aba4d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:31 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6b91bc3f-c3d7-4b98-b017-998f04d027cb tempest-SnapshotsActionsTest-1440055386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.83648238-9125-4109-ab09-3ee82cdea8db" returned: 0 in 0.308s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6b91bc3f-c3d7-4b98-b017-998f04d027cb tempest-SnapshotsActionsTest-1440055386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.563s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:31 devstack sudo[100487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ae67c3c8-9fc4-4752-84a9-886ddf1aba4d
Nov 05 09:45:31 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:31 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-6b91bc3f-c3d7-4b98-b017-998f04d027cb tempest-SnapshotsActionsTest-1440055386 None] Create snapshot completed successfully
Nov 05 09:45:31 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-80020ce6-21b1-456a-bd68-8aa7dd2a2dd9 tempest-ProjectReaderTests-272895753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ae67c3c8-9fc4-4752-84a9-886ddf1aba4d" returned: 0 in 0.418s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-80020ce6-21b1-456a-bd68-8aa7dd2a2dd9 tempest-ProjectReaderTests-272895753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ae67c3c8-9fc4-4752-84a9-886ddf1aba4d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:31 devstack sudo[100495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ae67c3c8-9fc4-4752-84a9-886ddf1aba4d
Nov 05 09:45:31 devstack sudo[100495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:31 devstack sudo[100495]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-80020ce6-21b1-456a-bd68-8aa7dd2a2dd9 tempest-ProjectReaderTests-272895753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ae67c3c8-9fc4-4752-84a9-886ddf1aba4d" returned: 0 in 0.242s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-80020ce6-21b1-456a-bd68-8aa7dd2a2dd9 tempest-ProjectReaderTests-272895753 None] Lock "cinder-quobyte-ae67c3c8-9fc4-4752-84a9-886ddf1aba4d" released by "delete_volume" :: held 0.733s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:31 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-80020ce6-21b1-456a-bd68-8aa7dd2a2dd9 tempest-ProjectReaderTests-272895753 None] Created reservations ['d0291b77-0e1d-4611-a3e4-7548add5e849', '95e7e71e-d8dc-471e-a287-4b27bbbd188c', 'e6fef7ce-920f-4e38-9cf9-b115b35afd2c', 'b6901749-dc9c-4430-a7f2-a5181d1f527c'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:45:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-80020ce6-21b1-456a-bd68-8aa7dd2a2dd9 tempest-ProjectReaderTests-272895753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-80020ce6-21b1-456a-bd68-8aa7dd2a2dd9 tempest-ProjectReaderTests-272895753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-80020ce6-21b1-456a-bd68-8aa7dd2a2dd9 tempest-ProjectReaderTests-272895753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:45:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-80020ce6-21b1-456a-bd68-8aa7dd2a2dd9 tempest-ProjectReaderTests-272895753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:45:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-80020ce6-21b1-456a-bd68-8aa7dd2a2dd9 tempest-ProjectReaderTests-272895753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-80020ce6-21b1-456a-bd68-8aa7dd2a2dd9 tempest-ProjectReaderTests-272895753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:31 devstack sudo[100498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:45:31 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:32 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-80020ce6-21b1-456a-bd68-8aa7dd2a2dd9 tempest-ProjectReaderTests-272895753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.284s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-80020ce6-21b1-456a-bd68-8aa7dd2a2dd9 tempest-ProjectReaderTests-272895753 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:45:32 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-80020ce6-21b1-456a-bd68-8aa7dd2a2dd9 tempest-ProjectReaderTests-272895753 None] Deleted volume successfully.
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-80020ce6-21b1-456a-bd68-8aa7dd2a2dd9 tempest-ProjectReaderTests-272895753 None] Lock "cinder-ae67c3c8-9fc4-4752-84a9-886ddf1aba4d-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5328dcf6-1a10-4b2a-9d15-8ccdbadbe8ed tempest-SnapshotsActionsTest-1919163482 None] Acquiring lock "cinder-83648238-9125-4109-ab09-3ee82cdea8db-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5328dcf6-1a10-4b2a-9d15-8ccdbadbe8ed tempest-SnapshotsActionsTest-1919163482 None] Lock "cinder-83648238-9125-4109-ab09-3ee82cdea8db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5328dcf6-1a10-4b2a-9d15-8ccdbadbe8ed tempest-SnapshotsActionsTest-1919163482 None] Acquiring lock "cinder-quobyte-2333b190-6c94-48ad-beab-0b2b9b0048f7" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5328dcf6-1a10-4b2a-9d15-8ccdbadbe8ed tempest-SnapshotsActionsTest-1919163482 None] Lock "cinder-quobyte-2333b190-6c94-48ad-beab-0b2b9b0048f7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5328dcf6-1a10-4b2a-9d15-8ccdbadbe8ed tempest-SnapshotsActionsTest-1919163482 None] Acquiring lock "cinder-quobyte-83648238-9125-4109-ab09-3ee82cdea8db" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5328dcf6-1a10-4b2a-9d15-8ccdbadbe8ed tempest-SnapshotsActionsTest-1919163482 None] Lock "cinder-quobyte-83648238-9125-4109-ab09-3ee82cdea8db" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-5328dcf6-1a10-4b2a-9d15-8ccdbadbe8ed tempest-SnapshotsActionsTest-1919163482 None] Deleting offline snapshot 83648238-9125-4109-ab09-3ee82cdea8db of volume 2333b190-6c94-48ad-beab-0b2b9b0048f7 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-5328dcf6-1a10-4b2a-9d15-8ccdbadbe8ed tempest-SnapshotsActionsTest-1919163482 None] snapshot_file for this snap is: volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.83648238-9125-4109-ab09-3ee82cdea8db {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3ca483-abe1-4190-9e05-6a4342b20753]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5328dcf6-1a10-4b2a-9d15-8ccdbadbe8ed tempest-SnapshotsActionsTest-1919163482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.83648238-9125-4109-ab09-3ee82cdea8db {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:32 devstack sudo[100501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.83648238-9125-4109-ab09-3ee82cdea8db
Nov 05 09:45:32 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] Flow 'volume_create_manager' (5c3c9e36-22b2-4a91-ba88-dc7e481a9076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b79de382-07c0-40de-accd-ae8c27044ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b79de382-07c0-40de-accd-ae8c27044ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1771560375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48cd2a01-ead2-4d84-bf67-0054daa77b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8933accb8eb473884255e7d23bc46e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:45:33Z,use_quota=True,user_id='85df128c38624f8faeec9e9060320a00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b47e802-e87f-4492-88b3-a4159b5b56fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b47e802-e87f-4492-88b3-a4159b5b56fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8dbcbd1-c87f-44eb-8264-d41b904bde97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:32 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8dbcbd1-c87f-44eb-8264-d41b904bde97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48cd2a01-ead2-4d84-bf67-0054daa77b8a', 'volume_name': 'volume-48cd2a01-ead2-4d84-bf67-0054daa77b8a', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc5c4807-d614-4c0b-9554-ebe21475562a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc5c4807-d614-4c0b-9554-ebe21475562a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (986b86ef-d9a2-40fc-9589-cb4234f2c9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:32 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] Volume 48cd2a01-ead2-4d84-bf67-0054daa77b8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48cd2a01-ead2-4d84-bf67-0054daa77b8a', 'volume_size': 1}
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1771560375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48cd2a01-ead2-4d84-bf67-0054daa77b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8933accb8eb473884255e7d23bc46e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:45:33Z,use_quota=True,user_id='85df128c38624f8faeec9e9060320a00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] Creating volume 48cd2a01-ead2-4d84-bf67-0054daa77b8a {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:45:32 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48cd2a01-ead2-4d84-bf67-0054daa77b8a 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5328dcf6-1a10-4b2a-9d15-8ccdbadbe8ed tempest-SnapshotsActionsTest-1919163482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.83648238-9125-4109-ab09-3ee82cdea8db" returned: 0 in 0.469s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-5328dcf6-1a10-4b2a-9d15-8ccdbadbe8ed tempest-SnapshotsActionsTest-1919163482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2333b190-6c94-48ad-beab-0b2b9b0048f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:45:32 devstack sudo[100506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48cd2a01-ead2-4d84-bf67-0054daa77b8a 1073741824
Nov 05 09:45:32 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f9140a-c8b4-402a-9ee3-9e406c18cb99]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:45:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5328dcf6-1a10-4b2a-9d15-8ccdbadbe8ed tempest-SnapshotsActionsTest-1919163482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:32 devstack sudo[100508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609
Nov 05 09:45:32 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:33 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5328dcf6-1a10-4b2a-9d15-8ccdbadbe8ed tempest-SnapshotsActionsTest-1919163482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609" returned: 0 in 0.406s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:33 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-5328dcf6-1a10-4b2a-9d15-8ccdbadbe8ed tempest-SnapshotsActionsTest-1919163482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2333b190-6c94-48ad-beab-0b2b9b0048f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:45:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5328dcf6-1a10-4b2a-9d15-8ccdbadbe8ed tempest-SnapshotsActionsTest-1919163482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.83648238-9125-4109-ab09-3ee82cdea8db {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:33 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48cd2a01-ead2-4d84-bf67-0054daa77b8a 1073741824" returned: 0 in 0.471s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:33 devstack sudo[100517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.83648238-9125-4109-ab09-3ee82cdea8db
Nov 05 09:45:33 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48cd2a01-ead2-4d84-bf67-0054daa77b8a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:33 devstack sudo[100519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48cd2a01-ead2-4d84-bf67-0054daa77b8a
Nov 05 09:45:33 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:33 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48cd2a01-ead2-4d84-bf67-0054daa77b8a" returned: 0 in 0.274s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:33 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:45:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:33 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (986b86ef-d9a2-40fc-9589-cb4234f2c9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48cd2a01-ead2-4d84-bf67-0054daa77b8a', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:33 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (232e1a21-22ad-4602-9153-402f2ef98623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:33 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] Volume volume-48cd2a01-ead2-4d84-bf67-0054daa77b8a (48cd2a01-ead2-4d84-bf67-0054daa77b8a): created successfully
Nov 05 09:45:33 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (232e1a21-22ad-4602-9153-402f2ef98623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:33 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] Flow 'volume_create_manager' (5c3c9e36-22b2-4a91-ba88-dc7e481a9076) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:45:33 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-6663ca99-2840-4a15-9249-2a16e19037e2 tempest-ProjectReaderTests-272895753 None] Created volume successfully.
Nov 05 09:45:33 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5328dcf6-1a10-4b2a-9d15-8ccdbadbe8ed tempest-SnapshotsActionsTest-1919163482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.83648238-9125-4109-ab09-3ee82cdea8db" returned: 0 in 0.426s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5328dcf6-1a10-4b2a-9d15-8ccdbadbe8ed tempest-SnapshotsActionsTest-1919163482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.83648238-9125-4109-ab09-3ee82cdea8db {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:33 devstack sudo[100526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.83648238-9125-4109-ab09-3ee82cdea8db
Nov 05 09:45:33 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:33 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5328dcf6-1a10-4b2a-9d15-8ccdbadbe8ed tempest-SnapshotsActionsTest-1919163482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.83648238-9125-4109-ab09-3ee82cdea8db" returned: 0 in 0.253s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5328dcf6-1a10-4b2a-9d15-8ccdbadbe8ed tempest-SnapshotsActionsTest-1919163482 None] Lock "cinder-quobyte-83648238-9125-4109-ab09-3ee82cdea8db" released by "_delete_snapshot" :: held 1.663s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5328dcf6-1a10-4b2a-9d15-8ccdbadbe8ed tempest-SnapshotsActionsTest-1919163482 None] Lock "cinder-quobyte-2333b190-6c94-48ad-beab-0b2b9b0048f7" released by "delete_snapshot" :: held 1.690s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:34 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-5328dcf6-1a10-4b2a-9d15-8ccdbadbe8ed tempest-SnapshotsActionsTest-1919163482 None] Created reservations ['63734be1-bf7e-4712-9262-8380849ddee2', 'bcbfa0f0-4fbd-4b6b-8043-a9a0358e62f4', 'b8362b76-8732-4f01-803c-5a719e4b7589', 'd1d62de4-d8c1-44c8-b802-613cd7310ef3'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:45:34 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-5328dcf6-1a10-4b2a-9d15-8ccdbadbe8ed tempest-SnapshotsActionsTest-1919163482 None] Delete snapshot completed successfully.
Nov 05 09:45:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5328dcf6-1a10-4b2a-9d15-8ccdbadbe8ed tempest-SnapshotsActionsTest-1919163482 None] Lock "cinder-83648238-9125-4109-ab09-3ee82cdea8db-delete_snapshot" released by "delete_snapshot" :: held 1.836s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-853bf803-990a-4334-b4b8-1150f065b744 tempest-SnapshotsActionsTest-1440055386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-853bf803-990a-4334-b4b8-1150f065b744 tempest-SnapshotsActionsTest-1440055386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-853bf803-990a-4334-b4b8-1150f065b744 tempest-SnapshotsActionsTest-1440055386 None] Creating offline snapshot 3d13c7df-c13c-44e2-bd41-58c8afc9f7ff of volume 2333b190-6c94-48ad-beab-0b2b9b0048f7 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 09:45:34 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae27e0c1-306b-4d94-ae6a-2ef78f5ad014]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:45:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-853bf803-990a-4334-b4b8-1150f065b744 tempest-SnapshotsActionsTest-1440055386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0648215c-0a45-464a-80d4-6df32785f249 tempest-ProjectReaderTests-272895753 None] Acquiring lock "cinder-48cd2a01-ead2-4d84-bf67-0054daa77b8a-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0648215c-0a45-464a-80d4-6df32785f249 tempest-ProjectReaderTests-272895753 None] Lock "cinder-48cd2a01-ead2-4d84-bf67-0054daa77b8a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0648215c-0a45-464a-80d4-6df32785f249 tempest-ProjectReaderTests-272895753 None] Acquiring lock "cinder-quobyte-48cd2a01-ead2-4d84-bf67-0054daa77b8a" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:34 devstack sudo[100529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609
Nov 05 09:45:34 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0648215c-0a45-464a-80d4-6df32785f249 tempest-ProjectReaderTests-272895753 None] Lock "cinder-quobyte-48cd2a01-ead2-4d84-bf67-0054daa77b8a" acquired by "delete_volume" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:34 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[165e305a-fc2d-48f9-9e03-a2066387b2af]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:45:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0648215c-0a45-464a-80d4-6df32785f249 tempest-ProjectReaderTests-272895753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48cd2a01-ead2-4d84-bf67-0054daa77b8a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:35 devstack sudo[100531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48cd2a01-ead2-4d84-bf67-0054daa77b8a
Nov 05 09:45:35 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:35 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-853bf803-990a-4334-b4b8-1150f065b744 tempest-SnapshotsActionsTest-1440055386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609" returned: 0 in 0.411s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-853bf803-990a-4334-b4b8-1150f065b744 tempest-SnapshotsActionsTest-1440055386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2333b190-6c94-48ad-beab-0b2b9b0048f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:45:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-853bf803-990a-4334-b4b8-1150f065b744 tempest-SnapshotsActionsTest-1440055386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.3d13c7df-c13c-44e2-bd41-58c8afc9f7ff 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:35 devstack sudo[100536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.3d13c7df-c13c-44e2-bd41-58c8afc9f7ff 1G
Nov 05 09:45:35 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:35 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0648215c-0a45-464a-80d4-6df32785f249 tempest-ProjectReaderTests-272895753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48cd2a01-ead2-4d84-bf67-0054daa77b8a" returned: 0 in 0.426s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0648215c-0a45-464a-80d4-6df32785f249 tempest-ProjectReaderTests-272895753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48cd2a01-ead2-4d84-bf67-0054daa77b8a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:35 devstack sudo[100541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48cd2a01-ead2-4d84-bf67-0054daa77b8a
Nov 05 09:45:35 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:35 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0648215c-0a45-464a-80d4-6df32785f249 tempest-ProjectReaderTests-272895753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-48cd2a01-ead2-4d84-bf67-0054daa77b8a" returned: 0 in 0.307s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:35 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-853bf803-990a-4334-b4b8-1150f065b744 tempest-SnapshotsActionsTest-1440055386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.3d13c7df-c13c-44e2-bd41-58c8afc9f7ff 1G" returned: 0 in 0.507s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-853bf803-990a-4334-b4b8-1150f065b744 tempest-SnapshotsActionsTest-1440055386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.3d13c7df-c13c-44e2-bd41-58c8afc9f7ff {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0648215c-0a45-464a-80d4-6df32785f249 tempest-ProjectReaderTests-272895753 None] Lock "cinder-quobyte-48cd2a01-ead2-4d84-bf67-0054daa77b8a" released by "delete_volume" :: held 0.791s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:35 devstack sudo[100548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.3d13c7df-c13c-44e2-bd41-58c8afc9f7ff
Nov 05 09:45:35 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:35 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-0648215c-0a45-464a-80d4-6df32785f249 tempest-ProjectReaderTests-272895753 None] Created reservations ['1ea6e6c7-4fe7-41af-a126-963f8f6bc4f0', '25687795-d3b1-4d5e-af30-4339f0b3cf9a', '2776ce36-28f9-4b2b-ba5c-75326cf37ee4', '8293d11d-6cdd-4328-8b52-70f332435cbd'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:45:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0648215c-0a45-464a-80d4-6df32785f249 tempest-ProjectReaderTests-272895753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0648215c-0a45-464a-80d4-6df32785f249 tempest-ProjectReaderTests-272895753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0648215c-0a45-464a-80d4-6df32785f249 tempest-ProjectReaderTests-272895753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:45:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0648215c-0a45-464a-80d4-6df32785f249 tempest-ProjectReaderTests-272895753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:45:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0648215c-0a45-464a-80d4-6df32785f249 tempest-ProjectReaderTests-272895753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0648215c-0a45-464a-80d4-6df32785f249 tempest-ProjectReaderTests-272895753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:35 devstack sudo[100550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:45:35 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:36 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-853bf803-990a-4334-b4b8-1150f065b744 tempest-SnapshotsActionsTest-1440055386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.3d13c7df-c13c-44e2-bd41-58c8afc9f7ff" returned: 0 in 0.342s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:36 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-853bf803-990a-4334-b4b8-1150f065b744 tempest-SnapshotsActionsTest-1440055386 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.3d13c7df-c13c-44e2-bd41-58c8afc9f7ff is being set with open permissions: ugo+rw
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-853bf803-990a-4334-b4b8-1150f065b744 tempest-SnapshotsActionsTest-1440055386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.3d13c7df-c13c-44e2-bd41-58c8afc9f7ff {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:36 devstack sudo[100555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.3d13c7df-c13c-44e2-bd41-58c8afc9f7ff
Nov 05 09:45:36 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:36 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0648215c-0a45-464a-80d4-6df32785f249 tempest-ProjectReaderTests-272895753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.310s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-0648215c-0a45-464a-80d4-6df32785f249 tempest-ProjectReaderTests-272895753 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:45:36 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-0648215c-0a45-464a-80d4-6df32785f249 tempest-ProjectReaderTests-272895753 None] Deleted volume successfully.
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0648215c-0a45-464a-80d4-6df32785f249 tempest-ProjectReaderTests-272895753 None] Lock "cinder-48cd2a01-ead2-4d84-bf67-0054daa77b8a-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:36 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-853bf803-990a-4334-b4b8-1150f065b744 tempest-SnapshotsActionsTest-1440055386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.3d13c7df-c13c-44e2-bd41-58c8afc9f7ff" returned: 0 in 0.295s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-853bf803-990a-4334-b4b8-1150f065b744 tempest-SnapshotsActionsTest-1440055386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.684s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:36 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-853bf803-990a-4334-b4b8-1150f065b744 tempest-SnapshotsActionsTest-1440055386 None] Create snapshot completed successfully
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] Flow 'volume_create_manager' (52c6d588-c07f-4d80-98b1-8230bb00421c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdee7964-8ca9-40cb-8291-439173225220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdee7964-8ca9-40cb-8291-439173225220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-662632855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1858d7d3-be72-4725-9b7f-754f753bd683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8933accb8eb473884255e7d23bc46e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:45:37Z,use_quota=True,user_id='85df128c38624f8faeec9e9060320a00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01627a7c-02e5-4e08-a77b-a62f4ea9ea85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01627a7c-02e5-4e08-a77b-a62f4ea9ea85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b9c69bc-a3b0-472e-830e-8649e285db23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b9c69bc-a3b0-472e-830e-8649e285db23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1858d7d3-be72-4725-9b7f-754f753bd683', 'volume_name': 'volume-1858d7d3-be72-4725-9b7f-754f753bd683', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4377802-9799-46e0-9468-b476eb50a5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4377802-9799-46e0-9468-b476eb50a5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e07ed0-74d6-4381-b048-695afa6bd3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:36 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] Volume 1858d7d3-be72-4725-9b7f-754f753bd683: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1858d7d3-be72-4725-9b7f-754f753bd683', 'volume_size': 1}
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-662632855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1858d7d3-be72-4725-9b7f-754f753bd683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8933accb8eb473884255e7d23bc46e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:45:37Z,use_quota=True,user_id='85df128c38624f8faeec9e9060320a00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] Creating volume 1858d7d3-be72-4725-9b7f-754f753bd683 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:45:36 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1858d7d3-be72-4725-9b7f-754f753bd683 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:36 devstack sudo[100559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1858d7d3-be72-4725-9b7f-754f753bd683 1073741824
Nov 05 09:45:36 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-53273b18-43d6-4b63-8565-95cd053a3cec tempest-SnapshotsActionsTest-1919163482 None] Acquiring lock "cinder-3d13c7df-c13c-44e2-bd41-58c8afc9f7ff-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-53273b18-43d6-4b63-8565-95cd053a3cec tempest-SnapshotsActionsTest-1919163482 None] Lock "cinder-3d13c7df-c13c-44e2-bd41-58c8afc9f7ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-53273b18-43d6-4b63-8565-95cd053a3cec tempest-SnapshotsActionsTest-1919163482 None] Acquiring lock "cinder-quobyte-2333b190-6c94-48ad-beab-0b2b9b0048f7" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-53273b18-43d6-4b63-8565-95cd053a3cec tempest-SnapshotsActionsTest-1919163482 None] Lock "cinder-quobyte-2333b190-6c94-48ad-beab-0b2b9b0048f7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-53273b18-43d6-4b63-8565-95cd053a3cec tempest-SnapshotsActionsTest-1919163482 None] Acquiring lock "cinder-quobyte-3d13c7df-c13c-44e2-bd41-58c8afc9f7ff" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-53273b18-43d6-4b63-8565-95cd053a3cec tempest-SnapshotsActionsTest-1919163482 None] Lock "cinder-quobyte-3d13c7df-c13c-44e2-bd41-58c8afc9f7ff" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-53273b18-43d6-4b63-8565-95cd053a3cec tempest-SnapshotsActionsTest-1919163482 None] Deleting offline snapshot 3d13c7df-c13c-44e2-bd41-58c8afc9f7ff of volume 2333b190-6c94-48ad-beab-0b2b9b0048f7 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 09:45:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-53273b18-43d6-4b63-8565-95cd053a3cec tempest-SnapshotsActionsTest-1919163482 None] snapshot_file for this snap is: volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.3d13c7df-c13c-44e2-bd41-58c8afc9f7ff {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 09:45:37 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0898d0c-e45e-44d0-a785-d2c15bc38d07]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:45:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-53273b18-43d6-4b63-8565-95cd053a3cec tempest-SnapshotsActionsTest-1919163482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.3d13c7df-c13c-44e2-bd41-58c8afc9f7ff {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:37 devstack sudo[100565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.3d13c7df-c13c-44e2-bd41-58c8afc9f7ff
Nov 05 09:45:37 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:37 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1858d7d3-be72-4725-9b7f-754f753bd683 1073741824" returned: 0 in 0.522s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1858d7d3-be72-4725-9b7f-754f753bd683 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:37 devstack sudo[100567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1858d7d3-be72-4725-9b7f-754f753bd683
Nov 05 09:45:37 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:37 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-53273b18-43d6-4b63-8565-95cd053a3cec tempest-SnapshotsActionsTest-1919163482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.3d13c7df-c13c-44e2-bd41-58c8afc9f7ff" returned: 0 in 0.406s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-53273b18-43d6-4b63-8565-95cd053a3cec tempest-SnapshotsActionsTest-1919163482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2333b190-6c94-48ad-beab-0b2b9b0048f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:45:37 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2318a1b-d442-49ab-a958-f4ffdf1b3ce8]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:45:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-53273b18-43d6-4b63-8565-95cd053a3cec tempest-SnapshotsActionsTest-1919163482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:37 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1858d7d3-be72-4725-9b7f-754f753bd683" returned: 0 in 0.305s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:45:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:37 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=151,cinder:UPDATE=197,cinder:INSERT=47,cinder:DELETE=18 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:45:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e07ed0-74d6-4381-b048-695afa6bd3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1858d7d3-be72-4725-9b7f-754f753bd683', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b320a164-348f-45ab-9c8d-db4adc1aacc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:45:37 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=193,cinder:SELECT=155,cinder:INSERT=40,cinder:DELETE=13 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:45:37 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] Volume volume-1858d7d3-be72-4725-9b7f-754f753bd683 (1858d7d3-be72-4725-9b7f-754f753bd683): created successfully
Nov 05 09:45:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b320a164-348f-45ab-9c8d-db4adc1aacc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:45:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] Flow 'volume_create_manager' (52c6d588-c07f-4d80-98b1-8230bb00421c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:45:37 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-a0c04dca-787d-4e43-9eaa-86089c2eca6f tempest-ProjectReaderTests-272895753 None] Created volume successfully.
Nov 05 09:45:37 devstack sudo[100573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609
Nov 05 09:45:37 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:37 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-53273b18-43d6-4b63-8565-95cd053a3cec tempest-SnapshotsActionsTest-1919163482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609" returned: 0 in 0.400s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-53273b18-43d6-4b63-8565-95cd053a3cec tempest-SnapshotsActionsTest-1919163482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2333b190-6c94-48ad-beab-0b2b9b0048f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:45:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-53273b18-43d6-4b63-8565-95cd053a3cec tempest-SnapshotsActionsTest-1919163482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.3d13c7df-c13c-44e2-bd41-58c8afc9f7ff {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:37 devstack sudo[100578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.3d13c7df-c13c-44e2-bd41-58c8afc9f7ff
Nov 05 09:45:37 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:38 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-53273b18-43d6-4b63-8565-95cd053a3cec tempest-SnapshotsActionsTest-1919163482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.3d13c7df-c13c-44e2-bd41-58c8afc9f7ff" returned: 0 in 0.410s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-53273b18-43d6-4b63-8565-95cd053a3cec tempest-SnapshotsActionsTest-1919163482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.3d13c7df-c13c-44e2-bd41-58c8afc9f7ff {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:38 devstack sudo[100583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.3d13c7df-c13c-44e2-bd41-58c8afc9f7ff
Nov 05 09:45:38 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:38 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-53273b18-43d6-4b63-8565-95cd053a3cec tempest-SnapshotsActionsTest-1919163482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.3d13c7df-c13c-44e2-bd41-58c8afc9f7ff" returned: 0 in 0.268s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-53273b18-43d6-4b63-8565-95cd053a3cec tempest-SnapshotsActionsTest-1919163482 None] Lock "cinder-quobyte-3d13c7df-c13c-44e2-bd41-58c8afc9f7ff" released by "_delete_snapshot" :: held 1.604s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-53273b18-43d6-4b63-8565-95cd053a3cec tempest-SnapshotsActionsTest-1919163482 None] Lock "cinder-quobyte-2333b190-6c94-48ad-beab-0b2b9b0048f7" released by "delete_snapshot" :: held 1.630s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:38 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-53273b18-43d6-4b63-8565-95cd053a3cec tempest-SnapshotsActionsTest-1919163482 None] Created reservations ['43132295-c0fe-454e-9cf8-3e9b6530e1e5', '96f267f3-0dd2-4a4a-b1b2-5ef9ecc21aa0', '4c57ab0e-cddb-4723-8ea3-5932a915949c', '1a0a584a-4468-40fd-a637-cc8aa477896d'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:45:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-83d45c3b-f212-40d1-be01-9d3c820db8eb tempest-ProjectReaderTests-272895753 None] Acquiring lock "cinder-1858d7d3-be72-4725-9b7f-754f753bd683-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-83d45c3b-f212-40d1-be01-9d3c820db8eb tempest-ProjectReaderTests-272895753 None] Lock "cinder-1858d7d3-be72-4725-9b7f-754f753bd683-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:38 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-53273b18-43d6-4b63-8565-95cd053a3cec tempest-SnapshotsActionsTest-1919163482 None] Delete snapshot completed successfully.
Nov 05 09:45:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-53273b18-43d6-4b63-8565-95cd053a3cec tempest-SnapshotsActionsTest-1919163482 None] Lock "cinder-3d13c7df-c13c-44e2-bd41-58c8afc9f7ff-delete_snapshot" released by "delete_snapshot" :: held 1.813s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-83d45c3b-f212-40d1-be01-9d3c820db8eb tempest-ProjectReaderTests-272895753 None] Acquiring lock "cinder-quobyte-1858d7d3-be72-4725-9b7f-754f753bd683" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-83d45c3b-f212-40d1-be01-9d3c820db8eb tempest-ProjectReaderTests-272895753 None] Lock "cinder-quobyte-1858d7d3-be72-4725-9b7f-754f753bd683" acquired by "delete_volume" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:38 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bed4281-6f95-4bec-b4a2-1e212c34e35b]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:45:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-83d45c3b-f212-40d1-be01-9d3c820db8eb tempest-ProjectReaderTests-272895753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1858d7d3-be72-4725-9b7f-754f753bd683 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:38 devstack sudo[100586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1858d7d3-be72-4725-9b7f-754f753bd683
Nov 05 09:45:38 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:39 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-83d45c3b-f212-40d1-be01-9d3c820db8eb tempest-ProjectReaderTests-272895753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1858d7d3-be72-4725-9b7f-754f753bd683" returned: 0 in 0.399s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-83d45c3b-f212-40d1-be01-9d3c820db8eb tempest-ProjectReaderTests-272895753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1858d7d3-be72-4725-9b7f-754f753bd683 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:39 devstack sudo[100591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1858d7d3-be72-4725-9b7f-754f753bd683
Nov 05 09:45:39 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f2ea194a-9138-4ef0-ae90-30740d013ec3 tempest-SnapshotsActionsTest-1440055386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f2ea194a-9138-4ef0-ae90-30740d013ec3 tempest-SnapshotsActionsTest-1440055386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-f2ea194a-9138-4ef0-ae90-30740d013ec3 tempest-SnapshotsActionsTest-1440055386 None] Creating offline snapshot 375c67d4-dc7f-42d6-9519-ff1f6dca2b8c of volume 2333b190-6c94-48ad-beab-0b2b9b0048f7 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 09:45:39 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-83d45c3b-f212-40d1-be01-9d3c820db8eb tempest-ProjectReaderTests-272895753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1858d7d3-be72-4725-9b7f-754f753bd683" returned: 0 in 0.305s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-83d45c3b-f212-40d1-be01-9d3c820db8eb tempest-ProjectReaderTests-272895753 None] Lock "cinder-quobyte-1858d7d3-be72-4725-9b7f-754f753bd683" released by "delete_volume" :: held 0.746s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:39 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[0199b301-c12e-4b3b-86e8-aca3cb7a20cb]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:45:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2ea194a-9138-4ef0-ae90-30740d013ec3 tempest-SnapshotsActionsTest-1440055386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:39 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-83d45c3b-f212-40d1-be01-9d3c820db8eb tempest-ProjectReaderTests-272895753 None] Created reservations ['da6f0dc8-9dcb-47d7-ac77-dab458325dea', '92792e96-11f2-48da-835d-21cbac6c5414', 'b76dd44a-f10a-4366-ac78-333076f04c17', 'dc537f2e-de13-48d1-91e3-cb710497c2aa'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:45:39 devstack sudo[100595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609
Nov 05 09:45:39 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-83d45c3b-f212-40d1-be01-9d3c820db8eb tempest-ProjectReaderTests-272895753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-83d45c3b-f212-40d1-be01-9d3c820db8eb tempest-ProjectReaderTests-272895753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-83d45c3b-f212-40d1-be01-9d3c820db8eb tempest-ProjectReaderTests-272895753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:45:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-83d45c3b-f212-40d1-be01-9d3c820db8eb tempest-ProjectReaderTests-272895753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:45:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-83d45c3b-f212-40d1-be01-9d3c820db8eb tempest-ProjectReaderTests-272895753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-83d45c3b-f212-40d1-be01-9d3c820db8eb tempest-ProjectReaderTests-272895753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:39 devstack sudo[100597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:45:39 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:39 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2ea194a-9138-4ef0-ae90-30740d013ec3 tempest-SnapshotsActionsTest-1440055386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609" returned: 0 in 0.415s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-f2ea194a-9138-4ef0-ae90-30740d013ec3 tempest-SnapshotsActionsTest-1440055386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2333b190-6c94-48ad-beab-0b2b9b0048f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:45:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2ea194a-9138-4ef0-ae90-30740d013ec3 tempest-SnapshotsActionsTest-1440055386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.375c67d4-dc7f-42d6-9519-ff1f6dca2b8c 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:39 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-83d45c3b-f212-40d1-be01-9d3c820db8eb tempest-ProjectReaderTests-272895753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.293s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:39 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-83d45c3b-f212-40d1-be01-9d3c820db8eb tempest-ProjectReaderTests-272895753 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:45:39 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-83d45c3b-f212-40d1-be01-9d3c820db8eb tempest-ProjectReaderTests-272895753 None] Deleted volume successfully.
Nov 05 09:45:39 devstack sudo[100603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.375c67d4-dc7f-42d6-9519-ff1f6dca2b8c 1G
Nov 05 09:45:39 devstack sudo[100603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-83d45c3b-f212-40d1-be01-9d3c820db8eb tempest-ProjectReaderTests-272895753 None] Lock "cinder-1858d7d3-be72-4725-9b7f-754f753bd683-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:40 devstack sudo[100603]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2ea194a-9138-4ef0-ae90-30740d013ec3 tempest-SnapshotsActionsTest-1440055386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.375c67d4-dc7f-42d6-9519-ff1f6dca2b8c 1G" returned: 0 in 0.542s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2ea194a-9138-4ef0-ae90-30740d013ec3 tempest-SnapshotsActionsTest-1440055386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.375c67d4-dc7f-42d6-9519-ff1f6dca2b8c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:40 devstack sudo[100644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.375c67d4-dc7f-42d6-9519-ff1f6dca2b8c
Nov 05 09:45:40 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:40 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2ea194a-9138-4ef0-ae90-30740d013ec3 tempest-SnapshotsActionsTest-1440055386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.375c67d4-dc7f-42d6-9519-ff1f6dca2b8c" returned: 0 in 0.316s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:40 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-f2ea194a-9138-4ef0-ae90-30740d013ec3 tempest-SnapshotsActionsTest-1440055386 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.375c67d4-dc7f-42d6-9519-ff1f6dca2b8c is being set with open permissions: ugo+rw
Nov 05 09:45:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2ea194a-9138-4ef0-ae90-30740d013ec3 tempest-SnapshotsActionsTest-1440055386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.375c67d4-dc7f-42d6-9519-ff1f6dca2b8c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:40 devstack sudo[100649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.375c67d4-dc7f-42d6-9519-ff1f6dca2b8c
Nov 05 09:45:40 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:41 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f2ea194a-9138-4ef0-ae90-30740d013ec3 tempest-SnapshotsActionsTest-1440055386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.375c67d4-dc7f-42d6-9519-ff1f6dca2b8c" returned: 0 in 0.262s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f2ea194a-9138-4ef0-ae90-30740d013ec3 tempest-SnapshotsActionsTest-1440055386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.655s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:41 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f2ea194a-9138-4ef0-ae90-30740d013ec3 tempest-SnapshotsActionsTest-1440055386 None] Create snapshot completed successfully
Nov 05 09:45:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1069f441-2dd4-4eb9-b168-24883df82692 tempest-SnapshotsActionsTest-1919163482 None] Acquiring lock "cinder-375c67d4-dc7f-42d6-9519-ff1f6dca2b8c-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1069f441-2dd4-4eb9-b168-24883df82692 tempest-SnapshotsActionsTest-1919163482 None] Lock "cinder-375c67d4-dc7f-42d6-9519-ff1f6dca2b8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1069f441-2dd4-4eb9-b168-24883df82692 tempest-SnapshotsActionsTest-1919163482 None] Acquiring lock "cinder-quobyte-2333b190-6c94-48ad-beab-0b2b9b0048f7" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1069f441-2dd4-4eb9-b168-24883df82692 tempest-SnapshotsActionsTest-1919163482 None] Lock "cinder-quobyte-2333b190-6c94-48ad-beab-0b2b9b0048f7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1069f441-2dd4-4eb9-b168-24883df82692 tempest-SnapshotsActionsTest-1919163482 None] Acquiring lock "cinder-quobyte-375c67d4-dc7f-42d6-9519-ff1f6dca2b8c" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1069f441-2dd4-4eb9-b168-24883df82692 tempest-SnapshotsActionsTest-1919163482 None] Lock "cinder-quobyte-375c67d4-dc7f-42d6-9519-ff1f6dca2b8c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-1069f441-2dd4-4eb9-b168-24883df82692 tempest-SnapshotsActionsTest-1919163482 None] Deleting offline snapshot 375c67d4-dc7f-42d6-9519-ff1f6dca2b8c of volume 2333b190-6c94-48ad-beab-0b2b9b0048f7 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 09:45:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-1069f441-2dd4-4eb9-b168-24883df82692 tempest-SnapshotsActionsTest-1919163482 None] snapshot_file for this snap is: volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.375c67d4-dc7f-42d6-9519-ff1f6dca2b8c {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 09:45:41 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c23427c-16b3-45cf-9c77-a33fef2d53f1]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:45:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1069f441-2dd4-4eb9-b168-24883df82692 tempest-SnapshotsActionsTest-1919163482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.375c67d4-dc7f-42d6-9519-ff1f6dca2b8c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:41 devstack sudo[100658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.375c67d4-dc7f-42d6-9519-ff1f6dca2b8c
Nov 05 09:45:41 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:42 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1069f441-2dd4-4eb9-b168-24883df82692 tempest-SnapshotsActionsTest-1919163482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.375c67d4-dc7f-42d6-9519-ff1f6dca2b8c" returned: 0 in 0.392s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-1069f441-2dd4-4eb9-b168-24883df82692 tempest-SnapshotsActionsTest-1919163482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2333b190-6c94-48ad-beab-0b2b9b0048f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:45:42 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8ede9e-d5be-4d4b-9867-5fc8199973b5]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:45:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1069f441-2dd4-4eb9-b168-24883df82692 tempest-SnapshotsActionsTest-1919163482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:42 devstack sudo[100663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609
Nov 05 09:45:42 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:42 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1069f441-2dd4-4eb9-b168-24883df82692 tempest-SnapshotsActionsTest-1919163482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609" returned: 0 in 0.348s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-1069f441-2dd4-4eb9-b168-24883df82692 tempest-SnapshotsActionsTest-1919163482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2333b190-6c94-48ad-beab-0b2b9b0048f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:45:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1069f441-2dd4-4eb9-b168-24883df82692 tempest-SnapshotsActionsTest-1919163482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.375c67d4-dc7f-42d6-9519-ff1f6dca2b8c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:42 devstack sudo[100668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.375c67d4-dc7f-42d6-9519-ff1f6dca2b8c
Nov 05 09:45:42 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:42 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1069f441-2dd4-4eb9-b168-24883df82692 tempest-SnapshotsActionsTest-1919163482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.375c67d4-dc7f-42d6-9519-ff1f6dca2b8c" returned: 0 in 0.421s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1069f441-2dd4-4eb9-b168-24883df82692 tempest-SnapshotsActionsTest-1919163482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.375c67d4-dc7f-42d6-9519-ff1f6dca2b8c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:43 devstack sudo[100673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.375c67d4-dc7f-42d6-9519-ff1f6dca2b8c
Nov 05 09:45:43 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:43 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1069f441-2dd4-4eb9-b168-24883df82692 tempest-SnapshotsActionsTest-1919163482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.375c67d4-dc7f-42d6-9519-ff1f6dca2b8c" returned: 0 in 0.300s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1069f441-2dd4-4eb9-b168-24883df82692 tempest-SnapshotsActionsTest-1919163482 None] Lock "cinder-quobyte-375c67d4-dc7f-42d6-9519-ff1f6dca2b8c" released by "_delete_snapshot" :: held 1.574s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1069f441-2dd4-4eb9-b168-24883df82692 tempest-SnapshotsActionsTest-1919163482 None] Lock "cinder-quobyte-2333b190-6c94-48ad-beab-0b2b9b0048f7" released by "delete_snapshot" :: held 1.603s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:43 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-1069f441-2dd4-4eb9-b168-24883df82692 tempest-SnapshotsActionsTest-1919163482 None] Created reservations ['f3ba0622-7bf0-4091-9aa5-b03ecd6aa8f5', '421e56c5-796e-4e84-a0c0-812e12d632fe', 'd2a337e3-9637-4e8f-a5a2-3a3fa1eb9288', '3f1cdafc-fd07-40ba-b987-02d4efa15e8e'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:45:43 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-1069f441-2dd4-4eb9-b168-24883df82692 tempest-SnapshotsActionsTest-1919163482 None] Delete snapshot completed successfully.
Nov 05 09:45:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1069f441-2dd4-4eb9-b168-24883df82692 tempest-SnapshotsActionsTest-1919163482 None] Lock "cinder-375c67d4-dc7f-42d6-9519-ff1f6dca2b8c-delete_snapshot" released by "delete_snapshot" :: held 1.748s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-43911d36-21e1-470c-ac4f-e827b7da1274 tempest-SnapshotsActionsTest-1440055386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-43911d36-21e1-470c-ac4f-e827b7da1274 tempest-SnapshotsActionsTest-1440055386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-43911d36-21e1-470c-ac4f-e827b7da1274 tempest-SnapshotsActionsTest-1440055386 None] Creating offline snapshot 38ca8870-f1a9-4ead-bef2-4583a58f8802 of volume 2333b190-6c94-48ad-beab-0b2b9b0048f7 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 09:45:44 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fda64a8-61eb-47ee-9473-f56fe3e54189]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:45:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-43911d36-21e1-470c-ac4f-e827b7da1274 tempest-SnapshotsActionsTest-1440055386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:44 devstack sudo[100676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609
Nov 05 09:45:44 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:44 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-43911d36-21e1-470c-ac4f-e827b7da1274 tempest-SnapshotsActionsTest-1440055386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609" returned: 0 in 0.377s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-43911d36-21e1-470c-ac4f-e827b7da1274 tempest-SnapshotsActionsTest-1440055386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2333b190-6c94-48ad-beab-0b2b9b0048f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:45:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-43911d36-21e1-470c-ac4f-e827b7da1274 tempest-SnapshotsActionsTest-1440055386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.38ca8870-f1a9-4ead-bef2-4583a58f8802 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:44 devstack sudo[100681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.38ca8870-f1a9-4ead-bef2-4583a58f8802 1G
Nov 05 09:45:44 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:45 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-43911d36-21e1-470c-ac4f-e827b7da1274 tempest-SnapshotsActionsTest-1440055386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.38ca8870-f1a9-4ead-bef2-4583a58f8802 1G" returned: 0 in 0.445s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-43911d36-21e1-470c-ac4f-e827b7da1274 tempest-SnapshotsActionsTest-1440055386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.38ca8870-f1a9-4ead-bef2-4583a58f8802 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:45 devstack sudo[100686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.38ca8870-f1a9-4ead-bef2-4583a58f8802
Nov 05 09:45:45 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:45 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-43911d36-21e1-470c-ac4f-e827b7da1274 tempest-SnapshotsActionsTest-1440055386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.38ca8870-f1a9-4ead-bef2-4583a58f8802" returned: 0 in 0.299s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:45 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-43911d36-21e1-470c-ac4f-e827b7da1274 tempest-SnapshotsActionsTest-1440055386 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.38ca8870-f1a9-4ead-bef2-4583a58f8802 is being set with open permissions: ugo+rw
Nov 05 09:45:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-43911d36-21e1-470c-ac4f-e827b7da1274 tempest-SnapshotsActionsTest-1440055386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.38ca8870-f1a9-4ead-bef2-4583a58f8802 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:45 devstack sudo[100691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.38ca8870-f1a9-4ead-bef2-4583a58f8802
Nov 05 09:45:45 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:45 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-43911d36-21e1-470c-ac4f-e827b7da1274 tempest-SnapshotsActionsTest-1440055386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.38ca8870-f1a9-4ead-bef2-4583a58f8802" returned: 0 in 0.256s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-43911d36-21e1-470c-ac4f-e827b7da1274 tempest-SnapshotsActionsTest-1440055386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.489s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:45 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-43911d36-21e1-470c-ac4f-e827b7da1274 tempest-SnapshotsActionsTest-1440055386 None] Create snapshot completed successfully
Nov 05 09:45:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-353945ec-864e-4cf0-9fed-98e48c8d1efc tempest-SnapshotsActionsTest-1919163482 None] Acquiring lock "cinder-38ca8870-f1a9-4ead-bef2-4583a58f8802-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-353945ec-864e-4cf0-9fed-98e48c8d1efc tempest-SnapshotsActionsTest-1919163482 None] Lock "cinder-38ca8870-f1a9-4ead-bef2-4583a58f8802-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-353945ec-864e-4cf0-9fed-98e48c8d1efc tempest-SnapshotsActionsTest-1919163482 None] Acquiring lock "cinder-quobyte-2333b190-6c94-48ad-beab-0b2b9b0048f7" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-353945ec-864e-4cf0-9fed-98e48c8d1efc tempest-SnapshotsActionsTest-1919163482 None] Lock "cinder-quobyte-2333b190-6c94-48ad-beab-0b2b9b0048f7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-353945ec-864e-4cf0-9fed-98e48c8d1efc tempest-SnapshotsActionsTest-1919163482 None] Acquiring lock "cinder-quobyte-38ca8870-f1a9-4ead-bef2-4583a58f8802" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-353945ec-864e-4cf0-9fed-98e48c8d1efc tempest-SnapshotsActionsTest-1919163482 None] Lock "cinder-quobyte-38ca8870-f1a9-4ead-bef2-4583a58f8802" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-353945ec-864e-4cf0-9fed-98e48c8d1efc tempest-SnapshotsActionsTest-1919163482 None] Deleting offline snapshot 38ca8870-f1a9-4ead-bef2-4583a58f8802 of volume 2333b190-6c94-48ad-beab-0b2b9b0048f7 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 09:45:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-353945ec-864e-4cf0-9fed-98e48c8d1efc tempest-SnapshotsActionsTest-1919163482 None] snapshot_file for this snap is: volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.38ca8870-f1a9-4ead-bef2-4583a58f8802 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 09:45:46 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[01135860-9f32-4cdc-9617-41c546d05b00]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:45:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-353945ec-864e-4cf0-9fed-98e48c8d1efc tempest-SnapshotsActionsTest-1919163482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.38ca8870-f1a9-4ead-bef2-4583a58f8802 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:46 devstack sudo[100694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.38ca8870-f1a9-4ead-bef2-4583a58f8802
Nov 05 09:45:46 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:46 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-353945ec-864e-4cf0-9fed-98e48c8d1efc tempest-SnapshotsActionsTest-1919163482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.38ca8870-f1a9-4ead-bef2-4583a58f8802" returned: 0 in 0.392s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-353945ec-864e-4cf0-9fed-98e48c8d1efc tempest-SnapshotsActionsTest-1919163482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2333b190-6c94-48ad-beab-0b2b9b0048f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:45:46 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc9fe97-af29-4e0f-84e8-b02db8556082]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:45:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-353945ec-864e-4cf0-9fed-98e48c8d1efc tempest-SnapshotsActionsTest-1919163482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:46 devstack sudo[100700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609
Nov 05 09:45:46 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:47 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-353945ec-864e-4cf0-9fed-98e48c8d1efc tempest-SnapshotsActionsTest-1919163482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609" returned: 0 in 0.384s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-353945ec-864e-4cf0-9fed-98e48c8d1efc tempest-SnapshotsActionsTest-1919163482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2333b190-6c94-48ad-beab-0b2b9b0048f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:45:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-353945ec-864e-4cf0-9fed-98e48c8d1efc tempest-SnapshotsActionsTest-1919163482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.38ca8870-f1a9-4ead-bef2-4583a58f8802 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:47 devstack sudo[100705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.38ca8870-f1a9-4ead-bef2-4583a58f8802
Nov 05 09:45:47 devstack sudo[100705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:47 devstack sudo[100705]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-353945ec-864e-4cf0-9fed-98e48c8d1efc tempest-SnapshotsActionsTest-1919163482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.38ca8870-f1a9-4ead-bef2-4583a58f8802" returned: 0 in 0.371s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-353945ec-864e-4cf0-9fed-98e48c8d1efc tempest-SnapshotsActionsTest-1919163482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.38ca8870-f1a9-4ead-bef2-4583a58f8802 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:47 devstack sudo[100710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.38ca8870-f1a9-4ead-bef2-4583a58f8802
Nov 05 09:45:47 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:47 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-353945ec-864e-4cf0-9fed-98e48c8d1efc tempest-SnapshotsActionsTest-1919163482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.38ca8870-f1a9-4ead-bef2-4583a58f8802" returned: 0 in 0.254s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-353945ec-864e-4cf0-9fed-98e48c8d1efc tempest-SnapshotsActionsTest-1919163482 None] Lock "cinder-quobyte-38ca8870-f1a9-4ead-bef2-4583a58f8802" released by "_delete_snapshot" :: held 1.517s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-353945ec-864e-4cf0-9fed-98e48c8d1efc tempest-SnapshotsActionsTest-1919163482 None] Lock "cinder-quobyte-2333b190-6c94-48ad-beab-0b2b9b0048f7" released by "delete_snapshot" :: held 1.538s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:47 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-353945ec-864e-4cf0-9fed-98e48c8d1efc tempest-SnapshotsActionsTest-1919163482 None] Created reservations ['6148738f-70aa-4872-8c3b-6b281fbe3d28', '7f706743-c983-4fb4-aaf3-31a69ef9a713', 'cd665293-bb4f-4e04-9810-339f1e104a54', 'd69f9afb-eba5-468e-a0bf-f0a8f51cd416'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:45:48 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-353945ec-864e-4cf0-9fed-98e48c8d1efc tempest-SnapshotsActionsTest-1919163482 None] Delete snapshot completed successfully.
Nov 05 09:45:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-353945ec-864e-4cf0-9fed-98e48c8d1efc tempest-SnapshotsActionsTest-1919163482 None] Lock "cinder-38ca8870-f1a9-4ead-bef2-4583a58f8802-delete_snapshot" released by "delete_snapshot" :: held 1.689s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cd56db98-995c-4fc8-80bf-32ce793d36e2 tempest-SnapshotsActionsTest-1440055386 None] Acquiring lock "cinder-31f2ffde-7b37-4f18-afb1-6fce5c13e609-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cd56db98-995c-4fc8-80bf-32ce793d36e2 tempest-SnapshotsActionsTest-1440055386 None] Lock "cinder-31f2ffde-7b37-4f18-afb1-6fce5c13e609-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cd56db98-995c-4fc8-80bf-32ce793d36e2 tempest-SnapshotsActionsTest-1440055386 None] Acquiring lock "cinder-quobyte-2333b190-6c94-48ad-beab-0b2b9b0048f7" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cd56db98-995c-4fc8-80bf-32ce793d36e2 tempest-SnapshotsActionsTest-1440055386 None] Lock "cinder-quobyte-2333b190-6c94-48ad-beab-0b2b9b0048f7" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cd56db98-995c-4fc8-80bf-32ce793d36e2 tempest-SnapshotsActionsTest-1440055386 None] Acquiring lock "cinder-quobyte-31f2ffde-7b37-4f18-afb1-6fce5c13e609" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cd56db98-995c-4fc8-80bf-32ce793d36e2 tempest-SnapshotsActionsTest-1440055386 None] Lock "cinder-quobyte-31f2ffde-7b37-4f18-afb1-6fce5c13e609" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-cd56db98-995c-4fc8-80bf-32ce793d36e2 tempest-SnapshotsActionsTest-1440055386 None] Deleting offline snapshot 31f2ffde-7b37-4f18-afb1-6fce5c13e609 of volume 2333b190-6c94-48ad-beab-0b2b9b0048f7 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 09:45:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-cd56db98-995c-4fc8-80bf-32ce793d36e2 tempest-SnapshotsActionsTest-1440055386 None] snapshot_file for this snap is: volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 09:45:49 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a43a9c5-e24e-41f3-bbfa-5dc03619de6b]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:45:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cd56db98-995c-4fc8-80bf-32ce793d36e2 tempest-SnapshotsActionsTest-1440055386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:49 devstack sudo[100713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609
Nov 05 09:45:49 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:49 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cd56db98-995c-4fc8-80bf-32ce793d36e2 tempest-SnapshotsActionsTest-1440055386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609" returned: 0 in 0.398s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-cd56db98-995c-4fc8-80bf-32ce793d36e2 tempest-SnapshotsActionsTest-1440055386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2333b190-6c94-48ad-beab-0b2b9b0048f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:45:49 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[b387bab5-6dba-4623-b841-f126f7bd6166]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:45:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cd56db98-995c-4fc8-80bf-32ce793d36e2 tempest-SnapshotsActionsTest-1440055386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:49 devstack sudo[100719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7
Nov 05 09:45:49 devstack sudo[100719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:50 devstack sudo[100719]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cd56db98-995c-4fc8-80bf-32ce793d36e2 tempest-SnapshotsActionsTest-1440055386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7" returned: 0 in 0.362s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cd56db98-995c-4fc8-80bf-32ce793d36e2 tempest-SnapshotsActionsTest-1440055386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:50 devstack sudo[100724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609
Nov 05 09:45:50 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:50 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cd56db98-995c-4fc8-80bf-32ce793d36e2 tempest-SnapshotsActionsTest-1440055386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609" returned: 0 in 0.340s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cd56db98-995c-4fc8-80bf-32ce793d36e2 tempest-SnapshotsActionsTest-1440055386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:50 devstack sudo[100729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609
Nov 05 09:45:50 devstack sudo[100729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:50 devstack sudo[100729]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cd56db98-995c-4fc8-80bf-32ce793d36e2 tempest-SnapshotsActionsTest-1440055386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7.31f2ffde-7b37-4f18-afb1-6fce5c13e609" returned: 0 in 0.254s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cd56db98-995c-4fc8-80bf-32ce793d36e2 tempest-SnapshotsActionsTest-1440055386 None] Lock "cinder-quobyte-31f2ffde-7b37-4f18-afb1-6fce5c13e609" released by "_delete_snapshot" :: held 1.477s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cd56db98-995c-4fc8-80bf-32ce793d36e2 tempest-SnapshotsActionsTest-1440055386 None] Lock "cinder-quobyte-2333b190-6c94-48ad-beab-0b2b9b0048f7" released by "delete_snapshot" :: held 1.505s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:50 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-cd56db98-995c-4fc8-80bf-32ce793d36e2 tempest-SnapshotsActionsTest-1440055386 None] Created reservations ['7bd6e55d-856b-4f90-ba24-453d272ea030', 'e18ff62a-a978-448b-871b-9b47392c2fce', '9086cb7a-dd39-4d82-baaf-aff5f51040ab', 'af9fa2a6-9984-439d-83d5-bc74e5946758'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:45:50 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-cd56db98-995c-4fc8-80bf-32ce793d36e2 tempest-SnapshotsActionsTest-1440055386 None] Delete snapshot completed successfully.
Nov 05 09:45:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cd56db98-995c-4fc8-80bf-32ce793d36e2 tempest-SnapshotsActionsTest-1440055386 None] Lock "cinder-31f2ffde-7b37-4f18-afb1-6fce5c13e609-delete_snapshot" released by "delete_snapshot" :: held 1.639s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-565918fb-af65-4bb3-a28c-06c880bcac69 tempest-SnapshotsActionsTest-1440055386 None] Acquiring lock "cinder-2333b190-6c94-48ad-beab-0b2b9b0048f7-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-565918fb-af65-4bb3-a28c-06c880bcac69 tempest-SnapshotsActionsTest-1440055386 None] Lock "cinder-2333b190-6c94-48ad-beab-0b2b9b0048f7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-565918fb-af65-4bb3-a28c-06c880bcac69 tempest-SnapshotsActionsTest-1440055386 None] Acquiring lock "cinder-quobyte-2333b190-6c94-48ad-beab-0b2b9b0048f7" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:45:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-565918fb-af65-4bb3-a28c-06c880bcac69 tempest-SnapshotsActionsTest-1440055386 None] Lock "cinder-quobyte-2333b190-6c94-48ad-beab-0b2b9b0048f7" acquired by "delete_volume" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:45:51 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[53091f16-d7d2-40a9-831f-958fa091e082]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:45:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-565918fb-af65-4bb3-a28c-06c880bcac69 tempest-SnapshotsActionsTest-1440055386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:51 devstack sudo[100732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7
Nov 05 09:45:51 devstack sudo[100732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:51 devstack sudo[100732]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-565918fb-af65-4bb3-a28c-06c880bcac69 tempest-SnapshotsActionsTest-1440055386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7" returned: 0 in 0.375s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-565918fb-af65-4bb3-a28c-06c880bcac69 tempest-SnapshotsActionsTest-1440055386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:51 devstack sudo[100737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7
Nov 05 09:45:51 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:52 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-565918fb-af65-4bb3-a28c-06c880bcac69 tempest-SnapshotsActionsTest-1440055386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2333b190-6c94-48ad-beab-0b2b9b0048f7" returned: 0 in 0.255s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-565918fb-af65-4bb3-a28c-06c880bcac69 tempest-SnapshotsActionsTest-1440055386 None] Lock "cinder-quobyte-2333b190-6c94-48ad-beab-0b2b9b0048f7" released by "delete_volume" :: held 0.698s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:45:52 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-565918fb-af65-4bb3-a28c-06c880bcac69 tempest-SnapshotsActionsTest-1440055386 None] Created reservations ['6503244b-8f4b-46bc-a2fc-e86618f81054', '6a6f0830-71dd-4c26-85cb-b39513007e6b', 'd37d21b1-c7bb-4d93-b984-ec0d9c5c9541', '047e55f2-d2d6-49e9-9257-1099154e69bf'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:45:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-565918fb-af65-4bb3-a28c-06c880bcac69 tempest-SnapshotsActionsTest-1440055386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:45:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-565918fb-af65-4bb3-a28c-06c880bcac69 tempest-SnapshotsActionsTest-1440055386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:45:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-565918fb-af65-4bb3-a28c-06c880bcac69 tempest-SnapshotsActionsTest-1440055386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:45:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-565918fb-af65-4bb3-a28c-06c880bcac69 tempest-SnapshotsActionsTest-1440055386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:45:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-565918fb-af65-4bb3-a28c-06c880bcac69 tempest-SnapshotsActionsTest-1440055386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:45:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-565918fb-af65-4bb3-a28c-06c880bcac69 tempest-SnapshotsActionsTest-1440055386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:45:52 devstack sudo[100740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:45:52 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:45:52 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root
Nov 05 09:45:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-565918fb-af65-4bb3-a28c-06c880bcac69 tempest-SnapshotsActionsTest-1440055386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.243s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:45:52 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-565918fb-af65-4bb3-a28c-06c880bcac69 tempest-SnapshotsActionsTest-1440055386 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:45:52 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-565918fb-af65-4bb3-a28c-06c880bcac69 tempest-SnapshotsActionsTest-1440055386 None] Deleted volume successfully.
Nov 05 09:45:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-565918fb-af65-4bb3-a28c-06c880bcac69 tempest-SnapshotsActionsTest-1440055386 None] Lock "cinder-2333b190-6c94-48ad-beab-0b2b9b0048f7-delete_volume" released by "delete_volume" :: held 1.139s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:46:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:46:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:46:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:46:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:46:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:46:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:46:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:46:00 devstack sudo[100744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:46:00 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:46:00 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root
Nov 05 09:46:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.272s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:46:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:46:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:46:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 28 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:46:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>, <Thread(tpool_thread_0, started daemon 132223357408960)>, <Thread(tpool_thread_1, started daemon 132223349016256)>, <Thread(tpool_thread_2, started daemon 132223340623552)>, <Thread(tpool_thread_3, started daemon 132223332230848)>, <Thread(tpool_thread_4, started daemon 132223323838144)>, <Thread(tpool_thread_5, started daemon 132223315445440)>, <Thread(tpool_thread_6, started daemon 132223307052736)>, <Thread(tpool_thread_7, started daemon 132223298660032)>, <Thread(tpool_thread_8, started daemon 132223290250944)>, <Thread(tpool_thread_9, started daemon 132223281841856)>, <Thread(tpool_thread_10, started daemon 132223273432768)>, <Thread(tpool_thread_11, started daemon 132223265023680)>, <Thread(tpool_thread_12, started daemon 132223256614592)>, <Thread(tpool_thread_13, started daemon 132223248205504)>, <Thread(tpool_thread_14, started daemon 132223239796416)>, <Thread(tpool_thread_15, started daemon 132223231387328)>, <Thread(tpool_thread_16, started daemon 132223222978240)>, <Thread(tpool_thread_17, started daemon 132223214569152)>, <Thread(tpool_thread_18, started daemon 132223206160064)>, <Thread(tpool_thread_19, started daemon 132223197750976)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:46:02 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=44,cinder:DELETE=2,cinder:SELECT=33,cinder:INSERT=13 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:46:02 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=35,cinder:INSERT=11,cinder:UPDATE=37,cinder:DELETE=3 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:46:13 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:46:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] Flow 'volume_create_manager' (91ab6365-9024-4de3-a01c-8e2b77ba25c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:46:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (335aefb8-df2f-4db9-9953-7ea5798cab1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:46:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (335aefb8-df2f-4db9-9953-7ea5798cab1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-938092259',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52662d89-ac69-4390-a888-29f39a4c0166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6b1f6f6fd1642d29ac3694484692062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:46:14Z,use_quota=True,user_id='cb147b966b6945798cf1d3b601254c33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:46:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f971f9-f2e7-4193-a4fe-8b0348bc5250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:46:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f971f9-f2e7-4193-a4fe-8b0348bc5250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:46:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe106ae7-afc8-4174-a012-4d5122f1f1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:46:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe106ae7-afc8-4174-a012-4d5122f1f1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52662d89-ac69-4390-a888-29f39a4c0166', 'volume_name': 'volume-52662d89-ac69-4390-a888-29f39a4c0166', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:46:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (876a6828-1ab8-40a4-b49e-fb24c9ebff39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:46:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (876a6828-1ab8-40a4-b49e-fb24c9ebff39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:46:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1689962-8a4c-4bda-bf62-a8e2f8c3c7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:46:13 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] Volume 52662d89-ac69-4390-a888-29f39a4c0166: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52662d89-ac69-4390-a888-29f39a4c0166', 'volume_size': 1}
Nov 05 09:46:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:46:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:46:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-938092259',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52662d89-ac69-4390-a888-29f39a4c0166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6b1f6f6fd1642d29ac3694484692062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:46:14Z,use_quota=True,user_id='cb147b966b6945798cf1d3b601254c33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:46:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] Creating volume 52662d89-ac69-4390-a888-29f39a4c0166 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:46:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:46:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:46:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:46:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:46:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:46:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:46:13 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:46:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-52662d89-ac69-4390-a888-29f39a4c0166 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:46:13 devstack sudo[100755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-52662d89-ac69-4390-a888-29f39a4c0166 1073741824
Nov 05 09:46:13 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:46:14 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root
Nov 05 09:46:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-52662d89-ac69-4390-a888-29f39a4c0166 1073741824" returned: 0 in 0.443s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:46:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-52662d89-ac69-4390-a888-29f39a4c0166 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:46:14 devstack sudo[100761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-52662d89-ac69-4390-a888-29f39a4c0166
Nov 05 09:46:14 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:46:14 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root
Nov 05 09:46:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-52662d89-ac69-4390-a888-29f39a4c0166" returned: 0 in 0.240s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:46:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:46:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:46:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1689962-8a4c-4bda-bf62-a8e2f8c3c7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52662d89-ac69-4390-a888-29f39a4c0166', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:46:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36ae13aa-2c09-45ac-8333-5ae3d1c4864b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:46:14 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] Volume volume-52662d89-ac69-4390-a888-29f39a4c0166 (52662d89-ac69-4390-a888-29f39a4c0166): created successfully
Nov 05 09:46:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36ae13aa-2c09-45ac-8333-5ae3d1c4864b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:46:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] Flow 'volume_create_manager' (91ab6365-9024-4de3-a01c-8e2b77ba25c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:46:14 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-e4075860-0cbd-44a4-9831-0e12ed7a83c2 tempest-VolumeQuotasAdminTestJSON-907725877 None] Created volume successfully.
Nov 05 09:46:14 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0c5e82a9-2926-4b72-aa39-1e5ca099b5fc tempest-VolumeQuotasAdminTestJSON-907725877 None] Acquiring lock "cinder-52662d89-ac69-4390-a888-29f39a4c0166-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:46:14 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0c5e82a9-2926-4b72-aa39-1e5ca099b5fc tempest-VolumeQuotasAdminTestJSON-907725877 None] Lock "cinder-52662d89-ac69-4390-a888-29f39a4c0166-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:46:14 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0c5e82a9-2926-4b72-aa39-1e5ca099b5fc tempest-VolumeQuotasAdminTestJSON-907725877 None] Acquiring lock "cinder-quobyte-52662d89-ac69-4390-a888-29f39a4c0166" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:46:14 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0c5e82a9-2926-4b72-aa39-1e5ca099b5fc tempest-VolumeQuotasAdminTestJSON-907725877 None] Lock "cinder-quobyte-52662d89-ac69-4390-a888-29f39a4c0166" acquired by "delete_volume" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:46:14 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[a840c3ef-1850-4c91-be02-834bd20c6916]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:46:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0c5e82a9-2926-4b72-aa39-1e5ca099b5fc tempest-VolumeQuotasAdminTestJSON-907725877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-52662d89-ac69-4390-a888-29f39a4c0166 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:46:14 devstack sudo[100764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-52662d89-ac69-4390-a888-29f39a4c0166
Nov 05 09:46:14 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:46:15 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root
Nov 05 09:46:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0c5e82a9-2926-4b72-aa39-1e5ca099b5fc tempest-VolumeQuotasAdminTestJSON-907725877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-52662d89-ac69-4390-a888-29f39a4c0166" returned: 0 in 0.407s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:46:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0c5e82a9-2926-4b72-aa39-1e5ca099b5fc tempest-VolumeQuotasAdminTestJSON-907725877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-52662d89-ac69-4390-a888-29f39a4c0166 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:46:15 devstack sudo[100769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-52662d89-ac69-4390-a888-29f39a4c0166
Nov 05 09:46:15 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:46:15 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root
Nov 05 09:46:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0c5e82a9-2926-4b72-aa39-1e5ca099b5fc tempest-VolumeQuotasAdminTestJSON-907725877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-52662d89-ac69-4390-a888-29f39a4c0166" returned: 0 in 0.255s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:46:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0c5e82a9-2926-4b72-aa39-1e5ca099b5fc tempest-VolumeQuotasAdminTestJSON-907725877 None] Lock "cinder-quobyte-52662d89-ac69-4390-a888-29f39a4c0166" released by "delete_volume" :: held 0.704s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:46:15 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-0c5e82a9-2926-4b72-aa39-1e5ca099b5fc tempest-VolumeQuotasAdminTestJSON-907725877 None] Created reservations ['8ffbffcc-99f7-4a7e-bed1-5aec0287def5', '4f1fedd7-f21f-447a-8f1d-326084bd5cd3', 'cf4e6e0b-6107-45f4-bd62-37c135dc3eb7', '156df096-1eb6-4b3c-a155-1db176d69c0c'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:46:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0c5e82a9-2926-4b72-aa39-1e5ca099b5fc tempest-VolumeQuotasAdminTestJSON-907725877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:46:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0c5e82a9-2926-4b72-aa39-1e5ca099b5fc tempest-VolumeQuotasAdminTestJSON-907725877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:46:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0c5e82a9-2926-4b72-aa39-1e5ca099b5fc tempest-VolumeQuotasAdminTestJSON-907725877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:46:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0c5e82a9-2926-4b72-aa39-1e5ca099b5fc tempest-VolumeQuotasAdminTestJSON-907725877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:46:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0c5e82a9-2926-4b72-aa39-1e5ca099b5fc tempest-VolumeQuotasAdminTestJSON-907725877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:46:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0c5e82a9-2926-4b72-aa39-1e5ca099b5fc tempest-VolumeQuotasAdminTestJSON-907725877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:46:15 devstack sudo[100772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:46:15 devstack sudo[100772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:46:15 devstack sudo[100772]: pam_unix(sudo:session): session closed for user root
Nov 05 09:46:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0c5e82a9-2926-4b72-aa39-1e5ca099b5fc tempest-VolumeQuotasAdminTestJSON-907725877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.248s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:46:15 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-0c5e82a9-2926-4b72-aa39-1e5ca099b5fc tempest-VolumeQuotasAdminTestJSON-907725877 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:46:15 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-0c5e82a9-2926-4b72-aa39-1e5ca099b5fc tempest-VolumeQuotasAdminTestJSON-907725877 None] Deleted volume successfully.
Nov 05 09:46:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0c5e82a9-2926-4b72-aa39-1e5ca099b5fc tempest-VolumeQuotasAdminTestJSON-907725877 None] Lock "cinder-52662d89-ac69-4390-a888-29f39a4c0166-delete_volume" released by "delete_volume" :: held 1.139s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:46:16 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:46:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] Flow 'volume_create_manager' (4f6f719b-6e4f-49de-8c96-826ed30717fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:46:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7642e3db-da15-45ee-a7d5-199b157dd618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:46:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7642e3db-da15-45ee-a7d5-199b157dd618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1240525896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c458b57-8305-4347-ba57-ecd209908663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6b1f6f6fd1642d29ac3694484692062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:46:16Z,use_quota=True,user_id='cb147b966b6945798cf1d3b601254c33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:46:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4477487b-96c9-4b67-8123-6ca1e58d9428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:46:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4477487b-96c9-4b67-8123-6ca1e58d9428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:46:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb05caf9-f80d-4bbc-912e-c7a0923f881c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:46:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb05caf9-f80d-4bbc-912e-c7a0923f881c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c458b57-8305-4347-ba57-ecd209908663', 'volume_name': 'volume-0c458b57-8305-4347-ba57-ecd209908663', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:46:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb1ed13-2dae-4032-babc-223f2b1bd86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:46:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb1ed13-2dae-4032-babc-223f2b1bd86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:46:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2954469b-8c12-482b-a920-e78ee6ec12e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:46:16 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] Volume 0c458b57-8305-4347-ba57-ecd209908663: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c458b57-8305-4347-ba57-ecd209908663', 'volume_size': 1}
Nov 05 09:46:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:46:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:46:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1240525896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c458b57-8305-4347-ba57-ecd209908663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6b1f6f6fd1642d29ac3694484692062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:46:16Z,use_quota=True,user_id='cb147b966b6945798cf1d3b601254c33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:46:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] Creating volume 0c458b57-8305-4347-ba57-ecd209908663 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:46:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:46:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:46:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:46:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:46:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:46:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:46:16 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:46:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0c458b57-8305-4347-ba57-ecd209908663 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:46:16 devstack sudo[100775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0c458b57-8305-4347-ba57-ecd209908663 1073741824
Nov 05 09:46:16 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:46:16 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root
Nov 05 09:46:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0c458b57-8305-4347-ba57-ecd209908663 1073741824" returned: 0 in 0.403s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:46:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0c458b57-8305-4347-ba57-ecd209908663 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:46:16 devstack sudo[100780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0c458b57-8305-4347-ba57-ecd209908663
Nov 05 09:46:16 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:46:17 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root
Nov 05 09:46:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0c458b57-8305-4347-ba57-ecd209908663" returned: 0 in 0.254s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:46:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:46:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:46:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2954469b-8c12-482b-a920-e78ee6ec12e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c458b57-8305-4347-ba57-ecd209908663', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:46:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (728c41aa-00c5-4183-926c-991dc5e08cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:46:17 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] Volume volume-0c458b57-8305-4347-ba57-ecd209908663 (0c458b57-8305-4347-ba57-ecd209908663): created successfully
Nov 05 09:46:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (728c41aa-00c5-4183-926c-991dc5e08cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:46:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] Flow 'volume_create_manager' (4f6f719b-6e4f-49de-8c96-826ed30717fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:46:17 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-4a1a281e-600b-4dd1-a862-5ec3ed73154d tempest-VolumeQuotasAdminTestJSON-907725877 None] Created volume successfully.
Nov 05 09:46:17 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-10c97941-b259-4eec-94e6-225bde97708f tempest-VolumeQuotasAdminTestJSON-1084023623 None] Transfer volume completed successfully.
Nov 05 09:46:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-68590e66-ffad-4d41-be0d-ed4f0cbbc2c7 tempest-VolumeQuotasAdminTestJSON-1073043918 None] Acquiring lock "cinder-0c458b57-8305-4347-ba57-ecd209908663-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:46:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-68590e66-ffad-4d41-be0d-ed4f0cbbc2c7 tempest-VolumeQuotasAdminTestJSON-1073043918 None] Lock "cinder-0c458b57-8305-4347-ba57-ecd209908663-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:46:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-68590e66-ffad-4d41-be0d-ed4f0cbbc2c7 tempest-VolumeQuotasAdminTestJSON-1073043918 None] Acquiring lock "cinder-quobyte-0c458b57-8305-4347-ba57-ecd209908663" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:46:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-68590e66-ffad-4d41-be0d-ed4f0cbbc2c7 tempest-VolumeQuotasAdminTestJSON-1073043918 None] Lock "cinder-quobyte-0c458b57-8305-4347-ba57-ecd209908663" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:46:18 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[13364ad8-733e-48eb-9cb2-5a7aa35d7fd5]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:46:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-68590e66-ffad-4d41-be0d-ed4f0cbbc2c7 tempest-VolumeQuotasAdminTestJSON-1073043918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0c458b57-8305-4347-ba57-ecd209908663 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:46:18 devstack sudo[100783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0c458b57-8305-4347-ba57-ecd209908663
Nov 05 09:46:18 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:46:18 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root
Nov 05 09:46:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-68590e66-ffad-4d41-be0d-ed4f0cbbc2c7 tempest-VolumeQuotasAdminTestJSON-1073043918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0c458b57-8305-4347-ba57-ecd209908663" returned: 0 in 0.392s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:46:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-68590e66-ffad-4d41-be0d-ed4f0cbbc2c7 tempest-VolumeQuotasAdminTestJSON-1073043918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0c458b57-8305-4347-ba57-ecd209908663 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:46:18 devstack sudo[100789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0c458b57-8305-4347-ba57-ecd209908663
Nov 05 09:46:18 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:46:19 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root
Nov 05 09:46:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-68590e66-ffad-4d41-be0d-ed4f0cbbc2c7 tempest-VolumeQuotasAdminTestJSON-1073043918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0c458b57-8305-4347-ba57-ecd209908663" returned: 0 in 0.245s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:46:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-68590e66-ffad-4d41-be0d-ed4f0cbbc2c7 tempest-VolumeQuotasAdminTestJSON-1073043918 None] Lock "cinder-quobyte-0c458b57-8305-4347-ba57-ecd209908663" released by "delete_volume" :: held 0.681s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:46:19 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-68590e66-ffad-4d41-be0d-ed4f0cbbc2c7 tempest-VolumeQuotasAdminTestJSON-1073043918 None] Created reservations ['48ada453-53e9-4010-bec5-fa044f053651', '68ec22d0-4003-457e-9870-af5d7709990f', 'bf112ce1-d8a8-4d4b-846c-0d2b0a9aaf40', 'cd7f49be-433e-43f4-a02c-a309275df6d9'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:46:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-68590e66-ffad-4d41-be0d-ed4f0cbbc2c7 tempest-VolumeQuotasAdminTestJSON-1073043918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:46:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-68590e66-ffad-4d41-be0d-ed4f0cbbc2c7 tempest-VolumeQuotasAdminTestJSON-1073043918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:46:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-68590e66-ffad-4d41-be0d-ed4f0cbbc2c7 tempest-VolumeQuotasAdminTestJSON-1073043918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:46:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-68590e66-ffad-4d41-be0d-ed4f0cbbc2c7 tempest-VolumeQuotasAdminTestJSON-1073043918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:46:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-68590e66-ffad-4d41-be0d-ed4f0cbbc2c7 tempest-VolumeQuotasAdminTestJSON-1073043918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:46:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-68590e66-ffad-4d41-be0d-ed4f0cbbc2c7 tempest-VolumeQuotasAdminTestJSON-1073043918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:46:19 devstack sudo[100793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:46:19 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:46:19 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root
Nov 05 09:46:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-68590e66-ffad-4d41-be0d-ed4f0cbbc2c7 tempest-VolumeQuotasAdminTestJSON-1073043918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.248s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:46:19 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-68590e66-ffad-4d41-be0d-ed4f0cbbc2c7 tempest-VolumeQuotasAdminTestJSON-1073043918 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:46:19 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-68590e66-ffad-4d41-be0d-ed4f0cbbc2c7 tempest-VolumeQuotasAdminTestJSON-1073043918 None] Deleted volume successfully.
Nov 05 09:46:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-68590e66-ffad-4d41-be0d-ed4f0cbbc2c7 tempest-VolumeQuotasAdminTestJSON-1073043918 None] Lock "cinder-0c458b57-8305-4347-ba57-ecd209908663-delete_volume" released by "delete_volume" :: held 1.125s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Flow 'volume_create_manager' (14e63b92-4d19-4a61-8446-539679fb2bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fca29e2-f0f7-4a26-b558-745874523007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fca29e2-f0f7-4a26-b558-745874523007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1932443003',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88356634-405c-4227-bb99-914f5502a703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91768fa76878421ab7f265cfbe436c9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:46:27Z,use_quota=True,user_id='a6fed94f194b4ab5bdf3248684e6b695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (832a7c6b-c8fc-4f6a-bcfd-5001c4bb8e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (832a7c6b-c8fc-4f6a-bcfd-5001c4bb8e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e53ee8b1-cf0d-4783-9a54-f7428f8cf3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e53ee8b1-cf0d-4783-9a54-f7428f8cf3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88356634-405c-4227-bb99-914f5502a703', 'volume_name': 'volume-88356634-405c-4227-bb99-914f5502a703', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb1df8c-449c-4a31-9ca6-e03273eb0ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb1df8c-449c-4a31-9ca6-e03273eb0ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d412fb1-7408-4ab6-ac72-64acd0b5c8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:46:26 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Volume 88356634-405c-4227-bb99-914f5502a703: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88356634-405c-4227-bb99-914f5502a703', 'volume_size': 1}
Nov 05 09:46:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:46:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1932443003',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88356634-405c-4227-bb99-914f5502a703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91768fa76878421ab7f265cfbe436c9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:46:27Z,use_quota=True,user_id='a6fed94f194b4ab5bdf3248684e6b695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Creating volume 88356634-405c-4227-bb99-914f5502a703 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:46:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:46:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:46:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:46:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:46:26 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:46:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-88356634-405c-4227-bb99-914f5502a703 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:46:26 devstack sudo[100798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-88356634-405c-4227-bb99-914f5502a703 1073741824
Nov 05 09:46:26 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:46:27 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root
Nov 05 09:46:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-88356634-405c-4227-bb99-914f5502a703 1073741824" returned: 0 in 0.451s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:46:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-88356634-405c-4227-bb99-914f5502a703 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:46:27 devstack sudo[100804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-88356634-405c-4227-bb99-914f5502a703
Nov 05 09:46:27 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:46:27 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root
Nov 05 09:46:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-88356634-405c-4227-bb99-914f5502a703" returned: 0 in 0.240s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:46:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:46:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:46:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d412fb1-7408-4ab6-ac72-64acd0b5c8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88356634-405c-4227-bb99-914f5502a703', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:46:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (542cf66e-a5ca-4443-a816-5a58387431f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:46:27 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Volume volume-88356634-405c-4227-bb99-914f5502a703 (88356634-405c-4227-bb99-914f5502a703): created successfully
Nov 05 09:46:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (542cf66e-a5ca-4443-a816-5a58387431f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:46:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Flow 'volume_create_manager' (14e63b92-4d19-4a61-8446-539679fb2bc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:46:27 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-761795d2-8642-4639-a6cf-c64ab0fce7c3 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Created volume successfully.
Nov 05 09:46:28 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ca7d3725-2d3b-4d94-96bd-2a9ddca48654 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Acquiring lock "cinder-88356634-405c-4227-bb99-914f5502a703-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:46:28 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ca7d3725-2d3b-4d94-96bd-2a9ddca48654 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Lock "cinder-88356634-405c-4227-bb99-914f5502a703-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:46:28 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ca7d3725-2d3b-4d94-96bd-2a9ddca48654 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Acquiring lock "cinder-quobyte-88356634-405c-4227-bb99-914f5502a703" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:46:28 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ca7d3725-2d3b-4d94-96bd-2a9ddca48654 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Lock "cinder-quobyte-88356634-405c-4227-bb99-914f5502a703" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:46:28 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dd97aa-9386-4010-9b14-1a9130c7cf8d]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:46:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca7d3725-2d3b-4d94-96bd-2a9ddca48654 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-88356634-405c-4227-bb99-914f5502a703 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:46:29 devstack sudo[100809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-88356634-405c-4227-bb99-914f5502a703
Nov 05 09:46:29 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:46:29 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root
Nov 05 09:46:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca7d3725-2d3b-4d94-96bd-2a9ddca48654 tempest-VolumeQuotasNegativeTestJSON-418204907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-88356634-405c-4227-bb99-914f5502a703" returned: 0 in 0.358s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:46:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca7d3725-2d3b-4d94-96bd-2a9ddca48654 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-88356634-405c-4227-bb99-914f5502a703 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:46:29 devstack sudo[100815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-88356634-405c-4227-bb99-914f5502a703
Nov 05 09:46:29 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:46:29 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root
Nov 05 09:46:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca7d3725-2d3b-4d94-96bd-2a9ddca48654 tempest-VolumeQuotasNegativeTestJSON-418204907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-88356634-405c-4227-bb99-914f5502a703" returned: 0 in 0.251s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:46:29 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ca7d3725-2d3b-4d94-96bd-2a9ddca48654 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Lock "cinder-quobyte-88356634-405c-4227-bb99-914f5502a703" released by "delete_volume" :: held 0.653s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:46:29 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-ca7d3725-2d3b-4d94-96bd-2a9ddca48654 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Created reservations ['6864004d-73ed-42da-9806-64e1ac35aeb7', 'dd29934f-5070-4c8c-ae6e-f3d6d62edba7', '41d5ba9e-9488-4bd7-b3db-e031cb7a76dc', '84b31409-dd70-4d64-a233-38a70b11dd8e'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:46:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ca7d3725-2d3b-4d94-96bd-2a9ddca48654 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:46:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ca7d3725-2d3b-4d94-96bd-2a9ddca48654 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:46:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ca7d3725-2d3b-4d94-96bd-2a9ddca48654 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:46:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ca7d3725-2d3b-4d94-96bd-2a9ddca48654 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:46:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ca7d3725-2d3b-4d94-96bd-2a9ddca48654 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:46:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca7d3725-2d3b-4d94-96bd-2a9ddca48654 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:46:29 devstack sudo[100818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:46:29 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:46:30 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root
Nov 05 09:46:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca7d3725-2d3b-4d94-96bd-2a9ddca48654 tempest-VolumeQuotasNegativeTestJSON-418204907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.254s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:46:30 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-ca7d3725-2d3b-4d94-96bd-2a9ddca48654 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:46:30 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ca7d3725-2d3b-4d94-96bd-2a9ddca48654 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Deleted volume successfully.
Nov 05 09:46:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ca7d3725-2d3b-4d94-96bd-2a9ddca48654 tempest-VolumeQuotasNegativeTestJSON-418204907 None] Lock "cinder-88356634-405c-4227-bb99-914f5502a703-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:46:36 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:46:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Flow 'volume_create_manager' (e7b60e78-deff-4686-a9c6-8f806c1d355d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:46:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a2cc785-2666-44a5-8b69-203d4b3d95f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:46:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a2cc785-2666-44a5-8b69-203d4b3d95f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-932586475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb8f486-2656-4d4c-a685-b87e8e53664c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e9f6a7713e24a6e9484fcbff06e3b52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:46:36Z,use_quota=True,user_id='7a798333ddf94494833272367f3fffec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0f66442-7ca7-49a7-a227-4e66b61b5529),volume_type_id=a0f66442-7ca7-49a7-a227-4e66b61b5529)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:46:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f3fa69-110e-49f3-91b6-3ebcbd655970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:46:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f3fa69-110e-49f3-91b6-3ebcbd655970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:46:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eae2a19a-fbbf-4238-a632-31fed5883e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:46:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eae2a19a-fbbf-4238-a632-31fed5883e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beb8f486-2656-4d4c-a685-b87e8e53664c', 'volume_name': 'volume-beb8f486-2656-4d4c-a685-b87e8e53664c', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:46:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a55cbb-18d0-4659-ba35-62f34e7dd938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:46:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a55cbb-18d0-4659-ba35-62f34e7dd938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:46:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7effc081-dec2-4e73-ae52-5a9664babbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:46:36 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Volume beb8f486-2656-4d4c-a685-b87e8e53664c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beb8f486-2656-4d4c-a685-b87e8e53664c', 'volume_size': 1}
Nov 05 09:46:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:46:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:46:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-932586475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb8f486-2656-4d4c-a685-b87e8e53664c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e9f6a7713e24a6e9484fcbff06e3b52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:46:36Z,use_quota=True,user_id='7a798333ddf94494833272367f3fffec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0f66442-7ca7-49a7-a227-4e66b61b5529),volume_type_id=a0f66442-7ca7-49a7-a227-4e66b61b5529)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:46:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Creating volume beb8f486-2656-4d4c-a685-b87e8e53664c {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:46:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:46:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:46:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:46:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:46:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:46:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:46:36 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:46:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-beb8f486-2656-4d4c-a685-b87e8e53664c 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:46:36 devstack sudo[100821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-beb8f486-2656-4d4c-a685-b87e8e53664c 1073741824
Nov 05 09:46:36 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:46:36 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root
Nov 05 09:46:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-beb8f486-2656-4d4c-a685-b87e8e53664c 1073741824" returned: 0 in 0.396s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:46:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-beb8f486-2656-4d4c-a685-b87e8e53664c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:46:36 devstack sudo[100827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-beb8f486-2656-4d4c-a685-b87e8e53664c
Nov 05 09:46:36 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:46:36 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root
Nov 05 09:46:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-beb8f486-2656-4d4c-a685-b87e8e53664c" returned: 0 in 0.245s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:46:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:46:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:46:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7effc081-dec2-4e73-ae52-5a9664babbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beb8f486-2656-4d4c-a685-b87e8e53664c', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:46:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cb27646-cff2-4af5-833b-6fd5a6005bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:46:36 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Volume volume-beb8f486-2656-4d4c-a685-b87e8e53664c (beb8f486-2656-4d4c-a685-b87e8e53664c): created successfully
Nov 05 09:46:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cb27646-cff2-4af5-833b-6fd5a6005bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:46:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Flow 'volume_create_manager' (e7b60e78-deff-4686-a9c6-8f806c1d355d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:46:36 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-cd085061-e3b0-4590-966e-c6bb5768f726 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Created volume successfully.
Nov 05 09:46:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c2ef2c63-2aa5-42cc-86fd-6b2dbf8c2c7f tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:46:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c2ef2c63-2aa5-42cc-86fd-6b2dbf8c2c7f tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:46:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c2ef2c63-2aa5-42cc-86fd-6b2dbf8c2c7f tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:46:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c2ef2c63-2aa5-42cc-86fd-6b2dbf8c2c7f tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:46:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c2ef2c63-2aa5-42cc-86fd-6b2dbf8c2c7f tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:46:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c2ef2c63-2aa5-42cc-86fd-6b2dbf8c2c7f tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:46:37 devstack sudo[100830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:46:37 devstack sudo[100830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:46:37 devstack sudo[100830]: pam_unix(sudo:session): session closed for user root
Nov 05 09:46:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c2ef2c63-2aa5-42cc-86fd-6b2dbf8c2c7f tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.254s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:46:37 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-c2ef2c63-2aa5-42cc-86fd-6b2dbf8c2c7f tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:46:37 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c2ef2c63-2aa5-42cc-86fd-6b2dbf8c2c7f tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Retype volume completed successfully.
Nov 05 09:46:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-037a9587-4705-40bb-8f7e-fe0698a0f429 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Acquiring lock "cinder-beb8f486-2656-4d4c-a685-b87e8e53664c-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:46:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-037a9587-4705-40bb-8f7e-fe0698a0f429 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Lock "cinder-beb8f486-2656-4d4c-a685-b87e8e53664c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:46:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-037a9587-4705-40bb-8f7e-fe0698a0f429 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Acquiring lock "cinder-quobyte-beb8f486-2656-4d4c-a685-b87e8e53664c" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:46:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-037a9587-4705-40bb-8f7e-fe0698a0f429 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Lock "cinder-quobyte-beb8f486-2656-4d4c-a685-b87e8e53664c" acquired by "delete_volume" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:46:38 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e59e36-8fb3-4d6a-9744-30cde26200d1]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:46:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-037a9587-4705-40bb-8f7e-fe0698a0f429 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-beb8f486-2656-4d4c-a685-b87e8e53664c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:46:38 devstack sudo[100833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-beb8f486-2656-4d4c-a685-b87e8e53664c
Nov 05 09:46:38 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:46:39 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root
Nov 05 09:46:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-037a9587-4705-40bb-8f7e-fe0698a0f429 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-beb8f486-2656-4d4c-a685-b87e8e53664c" returned: 0 in 0.355s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:46:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-037a9587-4705-40bb-8f7e-fe0698a0f429 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-beb8f486-2656-4d4c-a685-b87e8e53664c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:46:39 devstack sudo[100838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-beb8f486-2656-4d4c-a685-b87e8e53664c
Nov 05 09:46:39 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:46:39 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root
Nov 05 09:46:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-037a9587-4705-40bb-8f7e-fe0698a0f429 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-beb8f486-2656-4d4c-a685-b87e8e53664c" returned: 0 in 0.271s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:46:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-037a9587-4705-40bb-8f7e-fe0698a0f429 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Lock "cinder-quobyte-beb8f486-2656-4d4c-a685-b87e8e53664c" released by "delete_volume" :: held 0.670s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:46:39 devstack cinder-volume[86649]: WARNING cinder.quota [None req-037a9587-4705-40bb-8f7e-fe0698a0f429 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 05 09:46:39 devstack cinder-volume[86649]: WARNING cinder.quota [None req-037a9587-4705-40bb-8f7e-fe0698a0f429 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 05 09:46:39 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-037a9587-4705-40bb-8f7e-fe0698a0f429 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Created reservations ['cbb0a548-6ab2-4dea-ae62-23076e2da6af', '345d0bf6-c86a-4d18-a27b-8d5cadbed178', 'c4247965-3ecf-459e-bf69-412015f9b867', '74de9551-eb08-434c-b112-0e66fae82c9d'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:46:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-037a9587-4705-40bb-8f7e-fe0698a0f429 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:46:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-037a9587-4705-40bb-8f7e-fe0698a0f429 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:46:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-037a9587-4705-40bb-8f7e-fe0698a0f429 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:46:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-037a9587-4705-40bb-8f7e-fe0698a0f429 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:46:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-037a9587-4705-40bb-8f7e-fe0698a0f429 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:46:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-037a9587-4705-40bb-8f7e-fe0698a0f429 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:46:39 devstack sudo[100842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:46:39 devstack sudo[100842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:46:39 devstack sudo[100842]: pam_unix(sudo:session): session closed for user root
Nov 05 09:46:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-037a9587-4705-40bb-8f7e-fe0698a0f429 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.249s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:46:39 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-037a9587-4705-40bb-8f7e-fe0698a0f429 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:46:39 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-037a9587-4705-40bb-8f7e-fe0698a0f429 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Deleted volume successfully.
Nov 05 09:46:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-037a9587-4705-40bb-8f7e-fe0698a0f429 tempest-VolumeRetypeWithoutMigrationTest-1392341899 None] Lock "cinder-beb8f486-2656-4d4c-a685-b87e8e53664c-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:46:49 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=32,cinder:INSERT=12,cinder:UPDATE=40,cinder:DELETE=4 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:46:49 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=39,cinder:UPDATE=57,cinder:DELETE=4,cinder:INSERT=8 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:47:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:47:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:47:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:47:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:47:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:47:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:47:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:00 devstack sudo[100890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:47:00 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:00 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.273s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:47:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:47:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 28 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:47:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>, <Thread(tpool_thread_0, started daemon 132223357408960)>, <Thread(tpool_thread_1, started daemon 132223349016256)>, <Thread(tpool_thread_2, started daemon 132223340623552)>, <Thread(tpool_thread_3, started daemon 132223332230848)>, <Thread(tpool_thread_4, started daemon 132223323838144)>, <Thread(tpool_thread_5, started daemon 132223315445440)>, <Thread(tpool_thread_6, started daemon 132223307052736)>, <Thread(tpool_thread_7, started daemon 132223298660032)>, <Thread(tpool_thread_8, started daemon 132223290250944)>, <Thread(tpool_thread_9, started daemon 132223281841856)>, <Thread(tpool_thread_10, started daemon 132223273432768)>, <Thread(tpool_thread_11, started daemon 132223265023680)>, <Thread(tpool_thread_12, started daemon 132223256614592)>, <Thread(tpool_thread_13, started daemon 132223248205504)>, <Thread(tpool_thread_14, started daemon 132223239796416)>, <Thread(tpool_thread_15, started daemon 132223231387328)>, <Thread(tpool_thread_16, started daemon 132223222978240)>, <Thread(tpool_thread_17, started daemon 132223214569152)>, <Thread(tpool_thread_18, started daemon 132223206160064)>, <Thread(tpool_thread_19, started daemon 132223197750976)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:47:03 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:47:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] Flow 'volume_create_manager' (3e6b4bef-c409-4735-be17-5db9a3455a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:47:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cb581d1-0b1b-4657-a00f-b2e7aa7d8296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:47:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cb581d1-0b1b-4657-a00f-b2e7aa7d8296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1372486060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc0d82bb-edb6-4ea0-9d22-0998a81d2328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a204105047284026b2b70e36c109fcfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:47:03Z,use_quota=True,user_id='1d232e52bb4544179ef42433c5a0f04e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:47:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94b11dab-66e0-4c71-9b58-31726e41bb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:47:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94b11dab-66e0-4c71-9b58-31726e41bb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:47:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1dc4bc5-1717-42ed-8e31-9b8d354dd984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:47:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1dc4bc5-1717-42ed-8e31-9b8d354dd984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc0d82bb-edb6-4ea0-9d22-0998a81d2328', 'volume_name': 'volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:47:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b10f0bf-1655-4a95-bf77-ca6189a92b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:47:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b10f0bf-1655-4a95-bf77-ca6189a92b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:47:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10bb7cb2-0d99-42c6-acf3-1cdff496fcf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:47:03 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] Volume fc0d82bb-edb6-4ea0-9d22-0998a81d2328: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328', 'volume_size': 1}
Nov 05 09:47:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:47:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:47:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1372486060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc0d82bb-edb6-4ea0-9d22-0998a81d2328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a204105047284026b2b70e36c109fcfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:47:03Z,use_quota=True,user_id='1d232e52bb4544179ef42433c5a0f04e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:47:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] Creating volume fc0d82bb-edb6-4ea0-9d22-0998a81d2328 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:47:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:47:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:47:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:47:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:47:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:47:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:47:03 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:47:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:03 devstack sudo[100893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328 1073741824
Nov 05 09:47:03 devstack sudo[100893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:03 devstack sudo[100893]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328 1073741824" returned: 0 in 0.461s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:03 devstack sudo[100899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328
Nov 05 09:47:03 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:04 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328" returned: 0 in 0.268s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:47:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:47:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10bb7cb2-0d99-42c6-acf3-1cdff496fcf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:47:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80a68ecf-4fef-4731-b0b4-85661e676f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:47:04 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] Volume volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328 (fc0d82bb-edb6-4ea0-9d22-0998a81d2328): created successfully
Nov 05 09:47:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80a68ecf-4fef-4731-b0b4-85661e676f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:47:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] Flow 'volume_create_manager' (3e6b4bef-c409-4735-be17-5db9a3455a31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:47:04 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-d65c56b5-d94b-4f8f-81e5-4e2ff1f0343a tempest-VolumesDeleteCascade-1825398870 None] Created volume successfully.
Nov 05 09:47:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-66f15993-f18d-40df-a553-37650a828eac tempest-VolumesDeleteCascade-1825398870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:47:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-66f15993-f18d-40df-a553-37650a828eac tempest-VolumesDeleteCascade-1825398870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:47:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-66f15993-f18d-40df-a553-37650a828eac tempest-VolumesDeleteCascade-1825398870 None] Creating offline snapshot 765b4f97-943f-44bc-bcc0-5b92f2344570 of volume fc0d82bb-edb6-4ea0-9d22-0998a81d2328 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 09:47:04 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef1e6f0-3710-4ecb-a554-4444f6f8058e]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:47:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-66f15993-f18d-40df-a553-37650a828eac tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:04 devstack sudo[100902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328
Nov 05 09:47:04 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:04 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-66f15993-f18d-40df-a553-37650a828eac tempest-VolumesDeleteCascade-1825398870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328" returned: 0 in 0.406s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-66f15993-f18d-40df-a553-37650a828eac tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.765b4f97-943f-44bc-bcc0-5b92f2344570 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:04 devstack sudo[100907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.765b4f97-943f-44bc-bcc0-5b92f2344570 1G
Nov 05 09:47:04 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:05 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-66f15993-f18d-40df-a553-37650a828eac tempest-VolumesDeleteCascade-1825398870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.765b4f97-943f-44bc-bcc0-5b92f2344570 1G" returned: 0 in 0.418s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-66f15993-f18d-40df-a553-37650a828eac tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.765b4f97-943f-44bc-bcc0-5b92f2344570 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:05 devstack sudo[100912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.765b4f97-943f-44bc-bcc0-5b92f2344570
Nov 05 09:47:05 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:05 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-66f15993-f18d-40df-a553-37650a828eac tempest-VolumesDeleteCascade-1825398870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.765b4f97-943f-44bc-bcc0-5b92f2344570" returned: 0 in 0.297s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:05 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-66f15993-f18d-40df-a553-37650a828eac tempest-VolumesDeleteCascade-1825398870 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.765b4f97-943f-44bc-bcc0-5b92f2344570 is being set with open permissions: ugo+rw
Nov 05 09:47:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-66f15993-f18d-40df-a553-37650a828eac tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.765b4f97-943f-44bc-bcc0-5b92f2344570 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:05 devstack sudo[100917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.765b4f97-943f-44bc-bcc0-5b92f2344570
Nov 05 09:47:05 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:05 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-66f15993-f18d-40df-a553-37650a828eac tempest-VolumesDeleteCascade-1825398870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.765b4f97-943f-44bc-bcc0-5b92f2344570" returned: 0 in 0.245s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-66f15993-f18d-40df-a553-37650a828eac tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:05 devstack sudo[100920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.info
Nov 05 09:47:05 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:06 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-66f15993-f18d-40df-a553-37650a828eac tempest-VolumesDeleteCascade-1825398870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.info" returned: 0 in 0.293s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:06 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-66f15993-f18d-40df-a553-37650a828eac tempest-VolumesDeleteCascade-1825398870 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.info is being set with open permissions: ugo+rw
Nov 05 09:47:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-66f15993-f18d-40df-a553-37650a828eac tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:06 devstack sudo[100923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.info
Nov 05 09:47:06 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:06 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-66f15993-f18d-40df-a553-37650a828eac tempest-VolumesDeleteCascade-1825398870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.info" returned: 0 in 0.250s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-66f15993-f18d-40df-a553-37650a828eac tempest-VolumesDeleteCascade-1825398870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.999s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:47:06 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-66f15993-f18d-40df-a553-37650a828eac tempest-VolumesDeleteCascade-1825398870 None] Create snapshot completed successfully
Nov 05 09:47:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f1e30da5-3562-45e2-bd3e-892eaa371799 tempest-VolumesDeleteCascade-1825398870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:47:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f1e30da5-3562-45e2-bd3e-892eaa371799 tempest-VolumesDeleteCascade-1825398870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:47:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-f1e30da5-3562-45e2-bd3e-892eaa371799 tempest-VolumesDeleteCascade-1825398870 None] Creating offline snapshot 186bde74-381a-488c-928a-47a0359feac5 of volume fc0d82bb-edb6-4ea0-9d22-0998a81d2328 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 09:47:06 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[854af94b-9e18-47d0-b110-c2d025544346]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:47:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f1e30da5-3562-45e2-bd3e-892eaa371799 tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.765b4f97-943f-44bc-bcc0-5b92f2344570 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:06 devstack sudo[100926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.765b4f97-943f-44bc-bcc0-5b92f2344570
Nov 05 09:47:06 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:07 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f1e30da5-3562-45e2-bd3e-892eaa371799 tempest-VolumesDeleteCascade-1825398870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.765b4f97-943f-44bc-bcc0-5b92f2344570" returned: 0 in 0.399s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:07 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-f1e30da5-3562-45e2-bd3e-892eaa371799 tempest-VolumesDeleteCascade-1825398870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:47:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f1e30da5-3562-45e2-bd3e-892eaa371799 tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.765b4f97-943f-44bc-bcc0-5b92f2344570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.186bde74-381a-488c-928a-47a0359feac5 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:07 devstack sudo[100931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.765b4f97-943f-44bc-bcc0-5b92f2344570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.186bde74-381a-488c-928a-47a0359feac5 1G
Nov 05 09:47:07 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:07 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f1e30da5-3562-45e2-bd3e-892eaa371799 tempest-VolumesDeleteCascade-1825398870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.765b4f97-943f-44bc-bcc0-5b92f2344570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.186bde74-381a-488c-928a-47a0359feac5 1G" returned: 0 in 0.469s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f1e30da5-3562-45e2-bd3e-892eaa371799 tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.765b4f97-943f-44bc-bcc0-5b92f2344570 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.186bde74-381a-488c-928a-47a0359feac5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:07 devstack sudo[100937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.765b4f97-943f-44bc-bcc0-5b92f2344570 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.186bde74-381a-488c-928a-47a0359feac5
Nov 05 09:47:07 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:07 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f1e30da5-3562-45e2-bd3e-892eaa371799 tempest-VolumesDeleteCascade-1825398870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.765b4f97-943f-44bc-bcc0-5b92f2344570 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.186bde74-381a-488c-928a-47a0359feac5" returned: 0 in 0.310s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:07 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-f1e30da5-3562-45e2-bd3e-892eaa371799 tempest-VolumesDeleteCascade-1825398870 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.186bde74-381a-488c-928a-47a0359feac5 is being set with open permissions: ugo+rw
Nov 05 09:47:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f1e30da5-3562-45e2-bd3e-892eaa371799 tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.186bde74-381a-488c-928a-47a0359feac5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:07 devstack sudo[100942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.186bde74-381a-488c-928a-47a0359feac5
Nov 05 09:47:07 devstack sudo[100942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:08 devstack sudo[100942]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f1e30da5-3562-45e2-bd3e-892eaa371799 tempest-VolumesDeleteCascade-1825398870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.186bde74-381a-488c-928a-47a0359feac5" returned: 0 in 0.264s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f1e30da5-3562-45e2-bd3e-892eaa371799 tempest-VolumesDeleteCascade-1825398870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.551s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:47:08 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f1e30da5-3562-45e2-bd3e-892eaa371799 tempest-VolumesDeleteCascade-1825398870 None] Create snapshot completed successfully
Nov 05 09:47:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Acquiring lock "cinder-fc0d82bb-edb6-4ea0-9d22-0998a81d2328-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:47:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Lock "cinder-fc0d82bb-edb6-4ea0-9d22-0998a81d2328-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:47:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Performing cascade delete. {{(pid=86649) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 05 09:47:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Acquiring lock "cinder-186bde74-381a-488c-928a-47a0359feac5-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:47:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Lock "cinder-186bde74-381a-488c-928a-47a0359feac5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:47:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Acquiring lock "cinder-quobyte-fc0d82bb-edb6-4ea0-9d22-0998a81d2328" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:47:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Lock "cinder-quobyte-fc0d82bb-edb6-4ea0-9d22-0998a81d2328" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:47:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Acquiring lock "cinder-quobyte-186bde74-381a-488c-928a-47a0359feac5" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:47:08 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Lock "cinder-quobyte-186bde74-381a-488c-928a-47a0359feac5" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:47:08 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Deleting offline snapshot 186bde74-381a-488c-928a-47a0359feac5 of volume fc0d82bb-edb6-4ea0-9d22-0998a81d2328 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 09:47:08 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] snapshot_file for this snap is: volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.186bde74-381a-488c-928a-47a0359feac5 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 09:47:09 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed07dc9-fe11-4e3f-a219-44a672814a6e]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:47:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.186bde74-381a-488c-928a-47a0359feac5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:09 devstack sudo[100945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.186bde74-381a-488c-928a-47a0359feac5
Nov 05 09:47:09 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:09 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.186bde74-381a-488c-928a-47a0359feac5" returned: 0 in 0.404s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:47:09 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedbefdd-9803-410b-903a-e69480981fdb]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:47:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.765b4f97-943f-44bc-bcc0-5b92f2344570 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:09 devstack sudo[100951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.765b4f97-943f-44bc-bcc0-5b92f2344570
Nov 05 09:47:09 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:09 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.765b4f97-943f-44bc-bcc0-5b92f2344570" returned: 0 in 0.394s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:47:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.186bde74-381a-488c-928a-47a0359feac5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:09 devstack sudo[100956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.186bde74-381a-488c-928a-47a0359feac5
Nov 05 09:47:09 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:10 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.186bde74-381a-488c-928a-47a0359feac5" returned: 0 in 0.385s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.186bde74-381a-488c-928a-47a0359feac5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:10 devstack sudo[100961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.186bde74-381a-488c-928a-47a0359feac5
Nov 05 09:47:10 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:10 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.186bde74-381a-488c-928a-47a0359feac5" returned: 0 in 0.259s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Lock "cinder-quobyte-186bde74-381a-488c-928a-47a0359feac5" released by "_delete_snapshot" :: held 1.540s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:47:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Lock "cinder-quobyte-fc0d82bb-edb6-4ea0-9d22-0998a81d2328" released by "delete_snapshot" :: held 1.561s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:47:10 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Created reservations ['9f2644d0-4d19-4c07-84b9-35225504a66b', '42f50836-b892-412c-8a00-bdcb024308a1', '690c89cd-b579-4718-bdaf-89535097242a', '2e0b1721-23d8-47ee-a5ee-c63049a90996'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:47:10 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Delete snapshot completed successfully.
Nov 05 09:47:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Lock "cinder-186bde74-381a-488c-928a-47a0359feac5-delete_snapshot" released by "delete_snapshot" :: held 1.756s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:47:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Acquiring lock "cinder-765b4f97-943f-44bc-bcc0-5b92f2344570-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:47:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Lock "cinder-765b4f97-943f-44bc-bcc0-5b92f2344570-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:47:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Acquiring lock "cinder-quobyte-fc0d82bb-edb6-4ea0-9d22-0998a81d2328" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:47:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Lock "cinder-quobyte-fc0d82bb-edb6-4ea0-9d22-0998a81d2328" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:47:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Acquiring lock "cinder-quobyte-765b4f97-943f-44bc-bcc0-5b92f2344570" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:47:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Lock "cinder-quobyte-765b4f97-943f-44bc-bcc0-5b92f2344570" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:47:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Deleting offline snapshot 765b4f97-943f-44bc-bcc0-5b92f2344570 of volume fc0d82bb-edb6-4ea0-9d22-0998a81d2328 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 09:47:10 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] snapshot_file for this snap is: volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.765b4f97-943f-44bc-bcc0-5b92f2344570 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 09:47:10 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3f5b9a-ef82-4504-a83a-10b06aa49893]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:47:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.765b4f97-943f-44bc-bcc0-5b92f2344570 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:10 devstack sudo[100964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.765b4f97-943f-44bc-bcc0-5b92f2344570
Nov 05 09:47:10 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:11 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.765b4f97-943f-44bc-bcc0-5b92f2344570" returned: 0 in 0.425s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:11 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:47:11 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c97d3d8-aa87-44c6-8d07-23bda1a12d78]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:47:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:11 devstack sudo[100970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328
Nov 05 09:47:11 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:11 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328" returned: 0 in 0.387s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.765b4f97-943f-44bc-bcc0-5b92f2344570 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:11 devstack sudo[100982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.765b4f97-943f-44bc-bcc0-5b92f2344570
Nov 05 09:47:11 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:11 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.765b4f97-943f-44bc-bcc0-5b92f2344570" returned: 0 in 0.360s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.765b4f97-943f-44bc-bcc0-5b92f2344570 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:11 devstack sudo[100987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.765b4f97-943f-44bc-bcc0-5b92f2344570
Nov 05 09:47:11 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:12 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328.765b4f97-943f-44bc-bcc0-5b92f2344570" returned: 0 in 0.271s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Lock "cinder-quobyte-765b4f97-943f-44bc-bcc0-5b92f2344570" released by "_delete_snapshot" :: held 1.549s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:47:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Lock "cinder-quobyte-fc0d82bb-edb6-4ea0-9d22-0998a81d2328" released by "delete_snapshot" :: held 1.576s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:47:12 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Created reservations ['f6fde7de-ecce-4c32-88d4-3aca96078a99', '49029db8-7cf5-49d0-b79b-af190a1ca68d', '55489b19-fce6-488b-83b3-db9c391c164a', '116b4545-5d77-4bbc-ae25-92e340367f34'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:47:12 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Delete snapshot completed successfully.
Nov 05 09:47:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Lock "cinder-765b4f97-943f-44bc-bcc0-5b92f2344570-delete_snapshot" released by "delete_snapshot" :: held 1.744s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:47:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Snapshots deleted, issuing volume delete {{(pid=86649) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 05 09:47:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Acquiring lock "cinder-quobyte-fc0d82bb-edb6-4ea0-9d22-0998a81d2328" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:47:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Lock "cinder-quobyte-fc0d82bb-edb6-4ea0-9d22-0998a81d2328" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:47:12 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c35adcd-d649-4da2-9f66-0cbf0b196065]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:47:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:12 devstack sudo[100990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328
Nov 05 09:47:12 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:12 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328" returned: 0 in 0.373s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:12 devstack sudo[100995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328
Nov 05 09:47:12 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:13 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc0d82bb-edb6-4ea0-9d22-0998a81d2328" returned: 0 in 0.251s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:13 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Lock "cinder-quobyte-fc0d82bb-edb6-4ea0-9d22-0998a81d2328" released by "delete_volume" :: held 0.688s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:47:13 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Created reservations ['aaa33173-cd27-4f2a-8921-e98a762ec35c', '05bed10d-b0da-4c03-9cd9-a5840b5f2bec', '08fecabd-69af-4bce-8bf1-d235f31045ba', '21655727-4ea3-4dc6-ade8-0e739a55b706'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:47:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:47:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:47:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:47:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:47:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:47:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:13 devstack sudo[100998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:47:13 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:13 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.268s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:13 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:47:13 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Deleted volume successfully.
Nov 05 09:47:13 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6ad1ef2f-4546-468c-bdc0-f23376a37953 tempest-VolumesDeleteCascade-1825398870 None] Lock "cinder-fc0d82bb-edb6-4ea0-9d22-0998a81d2328-delete_volume" released by "delete_volume" :: held 4.723s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:47:14 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:47:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] Flow 'volume_create_manager' (2e1517fe-048d-48c7-91a1-2cbf94200555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:47:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (903a88b9-1892-4bba-b25c-b39b0e26530b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:47:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (903a88b9-1892-4bba-b25c-b39b0e26530b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-857385090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bfb6f11-8c31-4945-baff-3edc86f114b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a204105047284026b2b70e36c109fcfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:47:15Z,use_quota=True,user_id='1d232e52bb4544179ef42433c5a0f04e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:47:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d84a6ec7-d6bd-4ff7-bf6a-dea970616461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:47:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d84a6ec7-d6bd-4ff7-bf6a-dea970616461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:47:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ede2a659-dff9-4238-bb1b-d97f6639d7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:47:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ede2a659-dff9-4238-bb1b-d97f6639d7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bfb6f11-8c31-4945-baff-3edc86f114b2', 'volume_name': 'volume-0bfb6f11-8c31-4945-baff-3edc86f114b2', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:47:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e55e378-5fe6-4668-b7dc-490f90805782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:47:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e55e378-5fe6-4668-b7dc-490f90805782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:47:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8d82547-3e00-4138-86cd-15044dba27ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:47:14 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] Volume 0bfb6f11-8c31-4945-baff-3edc86f114b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bfb6f11-8c31-4945-baff-3edc86f114b2', 'volume_size': 1}
Nov 05 09:47:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:47:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:47:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-857385090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bfb6f11-8c31-4945-baff-3edc86f114b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a204105047284026b2b70e36c109fcfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:47:15Z,use_quota=True,user_id='1d232e52bb4544179ef42433c5a0f04e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:47:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] Creating volume 0bfb6f11-8c31-4945-baff-3edc86f114b2 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:47:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:47:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:47:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:47:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:47:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:47:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:47:15 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:47:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:15 devstack sudo[101001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2 1073741824
Nov 05 09:47:15 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:15 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2 1073741824" returned: 0 in 0.459s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:15 devstack sudo[101006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2
Nov 05 09:47:15 devstack sudo[101006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:15 devstack sudo[101006]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2" returned: 0 in 0.272s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:47:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:47:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8d82547-3e00-4138-86cd-15044dba27ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bfb6f11-8c31-4945-baff-3edc86f114b2', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:47:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c95d1cd-ae03-4f3e-b4e5-d68726895daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:47:15 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] Volume volume-0bfb6f11-8c31-4945-baff-3edc86f114b2 (0bfb6f11-8c31-4945-baff-3edc86f114b2): created successfully
Nov 05 09:47:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c95d1cd-ae03-4f3e-b4e5-d68726895daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:47:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] Flow 'volume_create_manager' (2e1517fe-048d-48c7-91a1-2cbf94200555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:47:15 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-71b106c3-93d0-4bba-a3ed-632031c6c501 tempest-VolumesDeleteCascade-1825398870 None] Created volume successfully.
Nov 05 09:47:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c9c0ec99-62ef-4b34-a780-ffed717a8f80 tempest-VolumesDeleteCascade-1825398870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:47:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c9c0ec99-62ef-4b34-a780-ffed717a8f80 tempest-VolumesDeleteCascade-1825398870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:47:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c9c0ec99-62ef-4b34-a780-ffed717a8f80 tempest-VolumesDeleteCascade-1825398870 None] Creating offline snapshot ef3abd0b-5d37-4bcf-bf98-0c5642058ca7 of volume 0bfb6f11-8c31-4945-baff-3edc86f114b2 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 09:47:16 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4e07f4-9932-4c9d-8cff-7592a196801e]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:47:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c9c0ec99-62ef-4b34-a780-ffed717a8f80 tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:16 devstack sudo[101009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2
Nov 05 09:47:16 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:16 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c9c0ec99-62ef-4b34-a780-ffed717a8f80 tempest-VolumesDeleteCascade-1825398870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2" returned: 0 in 0.373s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c9c0ec99-62ef-4b34-a780-ffed717a8f80 tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2.ef3abd0b-5d37-4bcf-bf98-0c5642058ca7 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:16 devstack sudo[101014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2.ef3abd0b-5d37-4bcf-bf98-0c5642058ca7 1G
Nov 05 09:47:16 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:16 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c9c0ec99-62ef-4b34-a780-ffed717a8f80 tempest-VolumesDeleteCascade-1825398870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2.ef3abd0b-5d37-4bcf-bf98-0c5642058ca7 1G" returned: 0 in 0.400s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c9c0ec99-62ef-4b34-a780-ffed717a8f80 tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bfb6f11-8c31-4945-baff-3edc86f114b2 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2.ef3abd0b-5d37-4bcf-bf98-0c5642058ca7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:16 devstack sudo[101019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bfb6f11-8c31-4945-baff-3edc86f114b2 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2.ef3abd0b-5d37-4bcf-bf98-0c5642058ca7
Nov 05 09:47:16 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:17 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c9c0ec99-62ef-4b34-a780-ffed717a8f80 tempest-VolumesDeleteCascade-1825398870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bfb6f11-8c31-4945-baff-3edc86f114b2 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2.ef3abd0b-5d37-4bcf-bf98-0c5642058ca7" returned: 0 in 0.328s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:17 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-c9c0ec99-62ef-4b34-a780-ffed717a8f80 tempest-VolumesDeleteCascade-1825398870 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2.ef3abd0b-5d37-4bcf-bf98-0c5642058ca7 is being set with open permissions: ugo+rw
Nov 05 09:47:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c9c0ec99-62ef-4b34-a780-ffed717a8f80 tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2.ef3abd0b-5d37-4bcf-bf98-0c5642058ca7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:17 devstack sudo[101024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2.ef3abd0b-5d37-4bcf-bf98-0c5642058ca7
Nov 05 09:47:17 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:17 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c9c0ec99-62ef-4b34-a780-ffed717a8f80 tempest-VolumesDeleteCascade-1825398870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2.ef3abd0b-5d37-4bcf-bf98-0c5642058ca7" returned: 0 in 0.264s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c9c0ec99-62ef-4b34-a780-ffed717a8f80 tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:17 devstack sudo[101027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2.info
Nov 05 09:47:17 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:17 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c9c0ec99-62ef-4b34-a780-ffed717a8f80 tempest-VolumesDeleteCascade-1825398870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2.info" returned: 0 in 0.269s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:17 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-c9c0ec99-62ef-4b34-a780-ffed717a8f80 tempest-VolumesDeleteCascade-1825398870 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2.info is being set with open permissions: ugo+rw
Nov 05 09:47:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c9c0ec99-62ef-4b34-a780-ffed717a8f80 tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:17 devstack sudo[101030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2.info
Nov 05 09:47:17 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:18 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c9c0ec99-62ef-4b34-a780-ffed717a8f80 tempest-VolumesDeleteCascade-1825398870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2.info" returned: 0 in 0.264s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c9c0ec99-62ef-4b34-a780-ffed717a8f80 tempest-VolumesDeleteCascade-1825398870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.990s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:47:18 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c9c0ec99-62ef-4b34-a780-ffed717a8f80 tempest-VolumesDeleteCascade-1825398870 None] Create snapshot completed successfully
Nov 05 09:47:18 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:47:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Flow 'volume_create_manager' (8900a9e8-f135-452f-bf1f-1cc8d0880808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:47:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (550bf9da-f00f-4e23-81a9-0984e7e150f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:47:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (550bf9da-f00f-4e23-81a9-0984e7e150f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-198713675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a204105047284026b2b70e36c109fcfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ef3abd0b-5d37-4bcf-bf98-0c5642058ca7,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:47:19Z,use_quota=True,user_id='1d232e52bb4544179ef42433c5a0f04e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:47:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3033de4a-206d-441e-9b1d-aa3019632489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:47:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3033de4a-206d-441e-9b1d-aa3019632489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:47:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d95a4b1a-916e-43fc-b1a7-45966cded81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:47:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d95a4b1a-916e-43fc-b1a7-45966cded81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf', 'volume_name': 'volume-8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf', 'volume_size': 1, 'snapshot_id': 'ef3abd0b-5d37-4bcf-bf98-0c5642058ca7'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:47:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a764c6ee-92e0-48dd-a169-1da0e63fd4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:47:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a764c6ee-92e0-48dd-a169-1da0e63fd4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:47:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8beade55-ca6e-4efd-a127-90495f544d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:47:18 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Volume 8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf', 'volume_size': 1, 'snapshot_id': 'ef3abd0b-5d37-4bcf-bf98-0c5642058ca7'}
Nov 05 09:47:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:47:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:47:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Acquiring lock "cinder-quobyte-ef3abd0b-5d37-4bcf-bf98-0c5642058ca7-8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf" by "_create_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:47:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Lock "cinder-quobyte-ef3abd0b-5d37-4bcf-bf98-0c5642058ca7-8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:47:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Creating volume 8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf from snapshot ef3abd0b-5d37-4bcf-bf98-0c5642058ca7 {{(pid=86649) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 09:47:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:47:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:47:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:47:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:47:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:47:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:47:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Acquiring lock "cinder-quobyte-8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf" by "_copy_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:47:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Lock "cinder-quobyte-8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:47:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] snapshot: ef3abd0b-5d37-4bcf-bf98-0c5642058ca7, volume: 8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf,  {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 09:47:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:47:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:47:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:47:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:47:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:47:18 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[3202f24f-b4b4-4bb7-86c5-ad6dcdec9449]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:47:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2.ef3abd0b-5d37-4bcf-bf98-0c5642058ca7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:19 devstack sudo[101033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2.ef3abd0b-5d37-4bcf-bf98-0c5642058ca7
Nov 05 09:47:19 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:19 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2.ef3abd0b-5d37-4bcf-bf98-0c5642058ca7" returned: 0 in 0.352s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0bfb6f11-8c31-4945-baff-3edc86f114b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:47:19 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e43b778-5eb0-47a5-a170-c10f52b76b13]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:47:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:19 devstack sudo[101038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2
Nov 05 09:47:19 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:19 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2" returned: 0 in 0.406s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2 {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 09:47:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Creating direct copy from snapshot {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 09:47:19 devstack cinder-volume[86649]: DEBUG cinder.utils [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Path /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf not found in is_blk_device check {{(pid=86649) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 09:47:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:19 devstack sudo[101044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf
Nov 05 09:47:19 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:26 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf" returned: 0 in 6.358s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:26 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Image conversion details: src /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2, size 1024.00 MB, duration 6.36 sec, destination /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 09:47:26 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Converted 1024.00 MB image at 161.02 MB/s
Nov 05 09:47:26 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf is being set with open permissions: ugo+rw
Nov 05 09:47:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:26 devstack sudo[101058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf
Nov 05 09:47:26 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:26 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf" returned: 0 in 0.263s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:26 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Lock "cinder-quobyte-8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf" released by "_copy_volume_from_snapshot" :: held 7.462s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:47:26 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Lock "cinder-quobyte-ef3abd0b-5d37-4bcf-bf98-0c5642058ca7-8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf" released by "_create_volume_from_snapshot" :: held 7.532s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:47:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.548s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:47:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8beade55-ca6e-4efd-a127-90495f544d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf', 'volume_size': 1, 'snapshot_id': 'ef3abd0b-5d37-4bcf-bf98-0c5642058ca7'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:47:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9249dc1-a705-4c51-963e-75e0b5b2cbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:47:26 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Volume volume-8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf (8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf): created successfully
Nov 05 09:47:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9249dc1-a705-4c51-963e-75e0b5b2cbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:47:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Flow 'volume_create_manager' (8900a9e8-f135-452f-bf1f-1cc8d0880808) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:47:26 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-41b01ab9-fc23-49c6-bbc6-b53b6240782c tempest-VolumesDeleteCascade-1825398870 None] Created volume successfully.
Nov 05 09:47:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Acquiring lock "cinder-0bfb6f11-8c31-4945-baff-3edc86f114b2-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:47:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Lock "cinder-0bfb6f11-8c31-4945-baff-3edc86f114b2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:47:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Performing cascade delete. {{(pid=86649) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 05 09:47:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Acquiring lock "cinder-ef3abd0b-5d37-4bcf-bf98-0c5642058ca7-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:47:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Lock "cinder-ef3abd0b-5d37-4bcf-bf98-0c5642058ca7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:47:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Acquiring lock "cinder-quobyte-0bfb6f11-8c31-4945-baff-3edc86f114b2" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:47:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Lock "cinder-quobyte-0bfb6f11-8c31-4945-baff-3edc86f114b2" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:47:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Acquiring lock "cinder-quobyte-ef3abd0b-5d37-4bcf-bf98-0c5642058ca7" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:47:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Lock "cinder-quobyte-ef3abd0b-5d37-4bcf-bf98-0c5642058ca7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:47:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Deleting offline snapshot ef3abd0b-5d37-4bcf-bf98-0c5642058ca7 of volume 0bfb6f11-8c31-4945-baff-3edc86f114b2 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 09:47:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] snapshot_file for this snap is: volume-0bfb6f11-8c31-4945-baff-3edc86f114b2.ef3abd0b-5d37-4bcf-bf98-0c5642058ca7 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 09:47:27 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b45250-7142-4499-ab90-38e37421596c]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:47:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2.ef3abd0b-5d37-4bcf-bf98-0c5642058ca7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:27 devstack sudo[101061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2.ef3abd0b-5d37-4bcf-bf98-0c5642058ca7
Nov 05 09:47:27 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:28 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2.ef3abd0b-5d37-4bcf-bf98-0c5642058ca7" returned: 0 in 0.374s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0bfb6f11-8c31-4945-baff-3edc86f114b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:47:28 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53efdf5-a3a2-496d-a7fa-aed2f27ebed1]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:47:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:28 devstack sudo[101068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2
Nov 05 09:47:28 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:28 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2" returned: 0 in 0.540s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2.ef3abd0b-5d37-4bcf-bf98-0c5642058ca7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:28 devstack sudo[101074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2.ef3abd0b-5d37-4bcf-bf98-0c5642058ca7
Nov 05 09:47:28 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:28 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2.ef3abd0b-5d37-4bcf-bf98-0c5642058ca7" returned: 0 in 0.350s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2.ef3abd0b-5d37-4bcf-bf98-0c5642058ca7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:28 devstack sudo[101079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2.ef3abd0b-5d37-4bcf-bf98-0c5642058ca7
Nov 05 09:47:28 devstack sudo[101079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:29 devstack sudo[101079]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2.ef3abd0b-5d37-4bcf-bf98-0c5642058ca7" returned: 0 in 0.253s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:29 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Lock "cinder-quobyte-ef3abd0b-5d37-4bcf-bf98-0c5642058ca7" released by "_delete_snapshot" :: held 1.620s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:47:29 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Lock "cinder-quobyte-0bfb6f11-8c31-4945-baff-3edc86f114b2" released by "delete_snapshot" :: held 1.644s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:47:29 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Created reservations ['d20e7431-7ae1-4461-b589-b267c8890e8f', 'b9f1764c-2d32-40f9-b7cb-6a0b838506a8', '27141505-74fb-4931-ac31-2a1b197c7974', '0504bea9-f887-4e2d-9df0-f59f0a5f1958'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:47:29 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Delete snapshot completed successfully.
Nov 05 09:47:29 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Lock "cinder-ef3abd0b-5d37-4bcf-bf98-0c5642058ca7-delete_snapshot" released by "delete_snapshot" :: held 1.801s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:47:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Snapshots deleted, issuing volume delete {{(pid=86649) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 05 09:47:29 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Acquiring lock "cinder-quobyte-0bfb6f11-8c31-4945-baff-3edc86f114b2" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:47:29 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Lock "cinder-quobyte-0bfb6f11-8c31-4945-baff-3edc86f114b2" acquired by "delete_volume" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:47:29 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[3def2e40-745e-4540-b25f-22877da48b0b]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:47:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:29 devstack sudo[101083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2
Nov 05 09:47:29 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:29 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2" returned: 0 in 0.358s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:29 devstack sudo[101088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2
Nov 05 09:47:29 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:30 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0bfb6f11-8c31-4945-baff-3edc86f114b2" returned: 0 in 0.256s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Lock "cinder-quobyte-0bfb6f11-8c31-4945-baff-3edc86f114b2" released by "delete_volume" :: held 0.674s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:47:30 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Created reservations ['e65387fb-11de-48e5-898a-ba447f71a8f4', 'a32e31de-6292-4db5-aed4-bcbdab242f69', 'f3c65e7e-aabf-4778-9983-92314d022db4', '747b61fd-0c07-4a1c-8610-2e21eec1ec38'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:47:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:47:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:47:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:47:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:47:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:47:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:30 devstack sudo[101091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:47:30 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:30 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.246s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:30 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:47:30 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Deleted volume successfully.
Nov 05 09:47:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4b442249-5479-441b-881d-28f259d28fdf tempest-VolumesDeleteCascade-1825398870 None] Lock "cinder-0bfb6f11-8c31-4945-baff-3edc86f114b2-delete_volume" released by "delete_volume" :: held 2.962s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:47:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-73803a5c-9c01-43c1-83e1-7290b648b65d tempest-VolumesDeleteCascade-1825398870 None] Acquiring lock "cinder-8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:47:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-73803a5c-9c01-43c1-83e1-7290b648b65d tempest-VolumesDeleteCascade-1825398870 None] Lock "cinder-8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:47:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-73803a5c-9c01-43c1-83e1-7290b648b65d tempest-VolumesDeleteCascade-1825398870 None] Acquiring lock "cinder-quobyte-8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:47:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-73803a5c-9c01-43c1-83e1-7290b648b65d tempest-VolumesDeleteCascade-1825398870 None] Lock "cinder-quobyte-8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf" acquired by "delete_volume" :: waited 0.013s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:47:30 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab7220b-0f9d-4b34-b8e9-f6d9af19a00b]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:47:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-73803a5c-9c01-43c1-83e1-7290b648b65d tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:31 devstack sudo[101094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf
Nov 05 09:47:31 devstack sudo[101094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:31 devstack sudo[101094]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-73803a5c-9c01-43c1-83e1-7290b648b65d tempest-VolumesDeleteCascade-1825398870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf" returned: 0 in 0.360s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-73803a5c-9c01-43c1-83e1-7290b648b65d tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:31 devstack sudo[101099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf
Nov 05 09:47:31 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:31 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-73803a5c-9c01-43c1-83e1-7290b648b65d tempest-VolumesDeleteCascade-1825398870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf" returned: 0 in 0.245s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-73803a5c-9c01-43c1-83e1-7290b648b65d tempest-VolumesDeleteCascade-1825398870 None] Lock "cinder-quobyte-8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf" released by "delete_volume" :: held 0.647s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:47:31 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-73803a5c-9c01-43c1-83e1-7290b648b65d tempest-VolumesDeleteCascade-1825398870 None] Created reservations ['279ec0f7-a4b5-49e5-bd0b-ca89f54395f6', '7754b2f0-2cf9-427e-89ed-d9cb85a62101', '64efcaf7-a2bb-46ce-8c36-b91242acdc53', '3feba108-add8-4a2e-b657-855360465358'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:47:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-73803a5c-9c01-43c1-83e1-7290b648b65d tempest-VolumesDeleteCascade-1825398870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:47:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-73803a5c-9c01-43c1-83e1-7290b648b65d tempest-VolumesDeleteCascade-1825398870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:47:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-73803a5c-9c01-43c1-83e1-7290b648b65d tempest-VolumesDeleteCascade-1825398870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:47:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-73803a5c-9c01-43c1-83e1-7290b648b65d tempest-VolumesDeleteCascade-1825398870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:47:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-73803a5c-9c01-43c1-83e1-7290b648b65d tempest-VolumesDeleteCascade-1825398870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:47:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-73803a5c-9c01-43c1-83e1-7290b648b65d tempest-VolumesDeleteCascade-1825398870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:31 devstack sudo[101102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:47:31 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:31 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-73803a5c-9c01-43c1-83e1-7290b648b65d tempest-VolumesDeleteCascade-1825398870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.250s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:31 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-73803a5c-9c01-43c1-83e1-7290b648b65d tempest-VolumesDeleteCascade-1825398870 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:47:31 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-73803a5c-9c01-43c1-83e1-7290b648b65d tempest-VolumesDeleteCascade-1825398870 None] Deleted volume successfully.
Nov 05 09:47:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-73803a5c-9c01-43c1-83e1-7290b648b65d tempest-VolumesDeleteCascade-1825398870 None] Lock "cinder-8378b5e5-6ca1-41dd-bc8f-7bd85bc43abf-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:47:35 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:47:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] Flow 'volume_create_manager' (e57fe216-2af1-469c-8f98-addb6f1286dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:47:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (590e8091-9a0b-4b44-acfe-bb967b8ee889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:47:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (590e8091-9a0b-4b44-acfe-bb967b8ee889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-486095850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f81ba5ad-f38d-45c3-b766-befc8cf6689e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acb8765a048b46e2a7d40c12c0ae6d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:47:36Z,use_quota=True,user_id='77673352c289471cbc4020217a5ffd88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:47:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f25be30a-1df6-4889-ad1f-3bfacfa8e35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:47:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f25be30a-1df6-4889-ad1f-3bfacfa8e35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:47:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eff4198-c9e1-464c-8955-7ab6b5e67f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:47:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eff4198-c9e1-464c-8955-7ab6b5e67f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f81ba5ad-f38d-45c3-b766-befc8cf6689e', 'volume_name': 'volume-f81ba5ad-f38d-45c3-b766-befc8cf6689e', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:47:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f28b8f-1c6e-4332-82af-1c6dae6361e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:47:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f28b8f-1c6e-4332-82af-1c6dae6361e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:47:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (990d9a0b-6ce4-4dee-9087-3b568d2c0bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:47:35 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] Volume f81ba5ad-f38d-45c3-b766-befc8cf6689e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f81ba5ad-f38d-45c3-b766-befc8cf6689e', 'volume_size': 1}
Nov 05 09:47:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:47:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:47:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-486095850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f81ba5ad-f38d-45c3-b766-befc8cf6689e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acb8765a048b46e2a7d40c12c0ae6d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:47:36Z,use_quota=True,user_id='77673352c289471cbc4020217a5ffd88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:47:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] Creating volume f81ba5ad-f38d-45c3-b766-befc8cf6689e {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:47:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:47:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:47:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:47:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:47:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:47:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:47:35 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:47:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f81ba5ad-f38d-45c3-b766-befc8cf6689e 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:35 devstack sudo[101106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f81ba5ad-f38d-45c3-b766-befc8cf6689e 1073741824
Nov 05 09:47:35 devstack sudo[101106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:36 devstack sudo[101106]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f81ba5ad-f38d-45c3-b766-befc8cf6689e 1073741824" returned: 0 in 0.412s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f81ba5ad-f38d-45c3-b766-befc8cf6689e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:36 devstack sudo[101112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f81ba5ad-f38d-45c3-b766-befc8cf6689e
Nov 05 09:47:36 devstack sudo[101112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:36 devstack sudo[101112]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f81ba5ad-f38d-45c3-b766-befc8cf6689e" returned: 0 in 0.254s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:47:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:47:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (990d9a0b-6ce4-4dee-9087-3b568d2c0bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f81ba5ad-f38d-45c3-b766-befc8cf6689e', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:47:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f268975f-5370-4077-b56e-638da53cb5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:47:36 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] Volume volume-f81ba5ad-f38d-45c3-b766-befc8cf6689e (f81ba5ad-f38d-45c3-b766-befc8cf6689e): created successfully
Nov 05 09:47:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f268975f-5370-4077-b56e-638da53cb5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:47:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] Flow 'volume_create_manager' (e57fe216-2af1-469c-8f98-addb6f1286dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:47:36 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-0224f89f-f500-4751-a6a8-832653dcba98 tempest-VolumesMetadataTest-163009800 None] Created volume successfully.
Nov 05 09:47:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bcec1841-c45a-410f-bc3d-64ac8b4f0301 tempest-VolumesMetadataTest-163009800 None] Acquiring lock "cinder-f81ba5ad-f38d-45c3-b766-befc8cf6689e-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:47:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bcec1841-c45a-410f-bc3d-64ac8b4f0301 tempest-VolumesMetadataTest-163009800 None] Lock "cinder-f81ba5ad-f38d-45c3-b766-befc8cf6689e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:47:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bcec1841-c45a-410f-bc3d-64ac8b4f0301 tempest-VolumesMetadataTest-163009800 None] Acquiring lock "cinder-quobyte-f81ba5ad-f38d-45c3-b766-befc8cf6689e" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:47:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bcec1841-c45a-410f-bc3d-64ac8b4f0301 tempest-VolumesMetadataTest-163009800 None] Lock "cinder-quobyte-f81ba5ad-f38d-45c3-b766-befc8cf6689e" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:47:37 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cd5abd-5e62-4448-ac00-eb82e78b79ee]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:47:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bcec1841-c45a-410f-bc3d-64ac8b4f0301 tempest-VolumesMetadataTest-163009800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f81ba5ad-f38d-45c3-b766-befc8cf6689e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:37 devstack sudo[101115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f81ba5ad-f38d-45c3-b766-befc8cf6689e
Nov 05 09:47:37 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:37 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bcec1841-c45a-410f-bc3d-64ac8b4f0301 tempest-VolumesMetadataTest-163009800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f81ba5ad-f38d-45c3-b766-befc8cf6689e" returned: 0 in 0.372s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bcec1841-c45a-410f-bc3d-64ac8b4f0301 tempest-VolumesMetadataTest-163009800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f81ba5ad-f38d-45c3-b766-befc8cf6689e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:38 devstack sudo[101120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f81ba5ad-f38d-45c3-b766-befc8cf6689e
Nov 05 09:47:38 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:38 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bcec1841-c45a-410f-bc3d-64ac8b4f0301 tempest-VolumesMetadataTest-163009800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f81ba5ad-f38d-45c3-b766-befc8cf6689e" returned: 0 in 0.253s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bcec1841-c45a-410f-bc3d-64ac8b4f0301 tempest-VolumesMetadataTest-163009800 None] Lock "cinder-quobyte-f81ba5ad-f38d-45c3-b766-befc8cf6689e" released by "delete_volume" :: held 0.668s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:47:38 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-bcec1841-c45a-410f-bc3d-64ac8b4f0301 tempest-VolumesMetadataTest-163009800 None] Created reservations ['3bb097d7-42fd-4c34-9409-dfb0428e118e', 'aee36e4e-bfcf-4806-b789-4d67ea72165a', '07630393-4846-461f-b98d-2ee862046ce1', '02b1daab-3586-46e8-839d-7d5ab0240cd3'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:47:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bcec1841-c45a-410f-bc3d-64ac8b4f0301 tempest-VolumesMetadataTest-163009800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:47:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bcec1841-c45a-410f-bc3d-64ac8b4f0301 tempest-VolumesMetadataTest-163009800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:47:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-bcec1841-c45a-410f-bc3d-64ac8b4f0301 tempest-VolumesMetadataTest-163009800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:47:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-bcec1841-c45a-410f-bc3d-64ac8b4f0301 tempest-VolumesMetadataTest-163009800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:47:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bcec1841-c45a-410f-bc3d-64ac8b4f0301 tempest-VolumesMetadataTest-163009800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:47:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bcec1841-c45a-410f-bc3d-64ac8b4f0301 tempest-VolumesMetadataTest-163009800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:38 devstack sudo[101123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:47:38 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:38 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bcec1841-c45a-410f-bc3d-64ac8b4f0301 tempest-VolumesMetadataTest-163009800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.258s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:38 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-bcec1841-c45a-410f-bc3d-64ac8b4f0301 tempest-VolumesMetadataTest-163009800 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:47:38 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-bcec1841-c45a-410f-bc3d-64ac8b4f0301 tempest-VolumesMetadataTest-163009800 None] Deleted volume successfully.
Nov 05 09:47:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bcec1841-c45a-410f-bc3d-64ac8b4f0301 tempest-VolumesMetadataTest-163009800 None] Lock "cinder-f81ba5ad-f38d-45c3-b766-befc8cf6689e-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:47:48 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=58,cinder:UPDATE=61,cinder:INSERT=19,cinder:DELETE=7 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:47:48 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=69,cinder:SELECT=53,cinder:INSERT=15,cinder:DELETE=4 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:47:52 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:47:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] Flow 'volume_create_manager' (e239bb10-1b3b-4308-820e-c485d60c3477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:47:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3af1dcc-3332-4e72-aa63-1c11861df947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:47:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3af1dcc-3332-4e72-aa63-1c11861df947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1267441947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75575e25-c398-47c4-99a0-2228c2366dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05389823aeae4f27bb223b4713f7cd7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:47:53Z,use_quota=True,user_id='ea7d8128e1934baa96f81a67ecf7c640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:47:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa21208-7a8b-4b3c-9134-e48b028e0354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:47:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa21208-7a8b-4b3c-9134-e48b028e0354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:47:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5996a762-5702-41dd-a5b6-387fbf9acbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:47:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5996a762-5702-41dd-a5b6-387fbf9acbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75575e25-c398-47c4-99a0-2228c2366dd7', 'volume_name': 'volume-75575e25-c398-47c4-99a0-2228c2366dd7', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:47:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (285066a4-3949-474d-a18b-d19db9dc5ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:47:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (285066a4-3949-474d-a18b-d19db9dc5ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:47:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (486771d8-c636-47c3-874e-aea51b5ad757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:47:52 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] Volume 75575e25-c398-47c4-99a0-2228c2366dd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75575e25-c398-47c4-99a0-2228c2366dd7', 'volume_size': 1}
Nov 05 09:47:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:47:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:47:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1267441947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75575e25-c398-47c4-99a0-2228c2366dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05389823aeae4f27bb223b4713f7cd7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:47:53Z,use_quota=True,user_id='ea7d8128e1934baa96f81a67ecf7c640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:47:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] Creating volume 75575e25-c398-47c4-99a0-2228c2366dd7 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:47:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:47:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:47:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:47:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:47:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:47:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:47:52 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:47:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:52 devstack sudo[101172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7 1073741824
Nov 05 09:47:52 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:53 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7 1073741824" returned: 0 in 0.416s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:47:53 devstack sudo[101178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7
Nov 05 09:47:53 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:47:53 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root
Nov 05 09:47:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7" returned: 0 in 0.252s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:47:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:47:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:47:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (486771d8-c636-47c3-874e-aea51b5ad757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75575e25-c398-47c4-99a0-2228c2366dd7', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:47:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606a19e5-2947-4009-a044-34b90f69ec53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:47:53 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] Volume volume-75575e25-c398-47c4-99a0-2228c2366dd7 (75575e25-c398-47c4-99a0-2228c2366dd7): created successfully
Nov 05 09:47:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606a19e5-2947-4009-a044-34b90f69ec53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:47:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] Flow 'volume_create_manager' (e239bb10-1b3b-4308-820e-c485d60c3477) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:47:53 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-e7121dfa-ecc4-4d39-9c7c-7b2600f6c991 tempest-VolumesActionsTest-786279288 None] Created volume successfully.
Nov 05 09:48:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:48:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:48:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:48:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:48:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:48:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:48:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:48:00 devstack sudo[101265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:48:00 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:48:00 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root
Nov 05 09:48:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.252s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:48:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:48:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:48:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 28 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:48:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>, <Thread(tpool_thread_0, started daemon 132223357408960)>, <Thread(tpool_thread_1, started daemon 132223349016256)>, <Thread(tpool_thread_2, started daemon 132223340623552)>, <Thread(tpool_thread_3, started daemon 132223332230848)>, <Thread(tpool_thread_4, started daemon 132223323838144)>, <Thread(tpool_thread_5, started daemon 132223315445440)>, <Thread(tpool_thread_6, started daemon 132223307052736)>, <Thread(tpool_thread_7, started daemon 132223298660032)>, <Thread(tpool_thread_8, started daemon 132223290250944)>, <Thread(tpool_thread_9, started daemon 132223281841856)>, <Thread(tpool_thread_10, started daemon 132223273432768)>, <Thread(tpool_thread_11, started daemon 132223265023680)>, <Thread(tpool_thread_12, started daemon 132223256614592)>, <Thread(tpool_thread_13, started daemon 132223248205504)>, <Thread(tpool_thread_14, started daemon 132223239796416)>, <Thread(tpool_thread_15, started daemon 132223231387328)>, <Thread(tpool_thread_16, started daemon 132223222978240)>, <Thread(tpool_thread_17, started daemon 132223214569152)>, <Thread(tpool_thread_18, started daemon 132223206160064)>, <Thread(tpool_thread_19, started daemon 132223197750976)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:48:03 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:48:03 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:49:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:49:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:49:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:49:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:49:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:49:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:49:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:49:00 devstack sudo[101334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:49:00 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:49:00 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root
Nov 05 09:49:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.260s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:49:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:49:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:49:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 28 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:49:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>, <Thread(tpool_thread_0, started daemon 132223357408960)>, <Thread(tpool_thread_1, started daemon 132223349016256)>, <Thread(tpool_thread_2, started daemon 132223340623552)>, <Thread(tpool_thread_3, started daemon 132223332230848)>, <Thread(tpool_thread_4, started daemon 132223323838144)>, <Thread(tpool_thread_5, started daemon 132223315445440)>, <Thread(tpool_thread_6, started daemon 132223307052736)>, <Thread(tpool_thread_7, started daemon 132223298660032)>, <Thread(tpool_thread_8, started daemon 132223290250944)>, <Thread(tpool_thread_9, started daemon 132223281841856)>, <Thread(tpool_thread_10, started daemon 132223273432768)>, <Thread(tpool_thread_11, started daemon 132223265023680)>, <Thread(tpool_thread_12, started daemon 132223256614592)>, <Thread(tpool_thread_13, started daemon 132223248205504)>, <Thread(tpool_thread_14, started daemon 132223239796416)>, <Thread(tpool_thread_15, started daemon 132223231387328)>, <Thread(tpool_thread_16, started daemon 132223222978240)>, <Thread(tpool_thread_17, started daemon 132223214569152)>, <Thread(tpool_thread_18, started daemon 132223206160064)>, <Thread(tpool_thread_19, started daemon 132223197750976)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:49:06 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:49:06 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:49:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1117ac3f-4d5c-4e41-b25e-80b7490c9543 tempest-TestStampPattern-392278876 None] Acquiring lock "cinder-c971751a-ac28-46fc-9d9c-f01c7a21a0ac-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:49:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1117ac3f-4d5c-4e41-b25e-80b7490c9543 tempest-TestStampPattern-392278876 None] Lock "cinder-c971751a-ac28-46fc-9d9c-f01c7a21a0ac-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:49:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1117ac3f-4d5c-4e41-b25e-80b7490c9543 tempest-TestStampPattern-392278876 None] Acquiring lock "cinder-quobyte-c971751a-ac28-46fc-9d9c-f01c7a21a0ac" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:49:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1117ac3f-4d5c-4e41-b25e-80b7490c9543 tempest-TestStampPattern-392278876 None] Lock "cinder-quobyte-c971751a-ac28-46fc-9d9c-f01c7a21a0ac" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:49:56 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea07277-4f0b-4db6-8182-045cbd3fd6a7]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:49:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1117ac3f-4d5c-4e41-b25e-80b7490c9543 tempest-TestStampPattern-392278876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c971751a-ac28-46fc-9d9c-f01c7a21a0ac {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:49:56 devstack sudo[101429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c971751a-ac28-46fc-9d9c-f01c7a21a0ac
Nov 05 09:49:56 devstack sudo[101429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:49:57 devstack sudo[101429]: pam_unix(sudo:session): session closed for user root
Nov 05 09:49:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1117ac3f-4d5c-4e41-b25e-80b7490c9543 tempest-TestStampPattern-392278876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c971751a-ac28-46fc-9d9c-f01c7a21a0ac" returned: 0 in 0.367s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:49:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1117ac3f-4d5c-4e41-b25e-80b7490c9543 tempest-TestStampPattern-392278876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c971751a-ac28-46fc-9d9c-f01c7a21a0ac {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:49:57 devstack sudo[101434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c971751a-ac28-46fc-9d9c-f01c7a21a0ac
Nov 05 09:49:57 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:49:57 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root
Nov 05 09:49:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1117ac3f-4d5c-4e41-b25e-80b7490c9543 tempest-TestStampPattern-392278876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c971751a-ac28-46fc-9d9c-f01c7a21a0ac" returned: 0 in 0.251s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:49:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1117ac3f-4d5c-4e41-b25e-80b7490c9543 tempest-TestStampPattern-392278876 None] Lock "cinder-quobyte-c971751a-ac28-46fc-9d9c-f01c7a21a0ac" released by "delete_volume" :: held 0.665s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:49:57 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-1117ac3f-4d5c-4e41-b25e-80b7490c9543 tempest-TestStampPattern-392278876 None] Created reservations ['ae0a4ec9-6c98-416e-9381-5546718245b2', 'd4a1c7f8-dd77-424a-86cb-714029e88883', '4446df78-fb22-4ed2-b683-ce3b7ad2cb1b', '9cde96a6-80e3-47dd-bf5c-f0e98bfbc3bd'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:49:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1117ac3f-4d5c-4e41-b25e-80b7490c9543 tempest-TestStampPattern-392278876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:49:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1117ac3f-4d5c-4e41-b25e-80b7490c9543 tempest-TestStampPattern-392278876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:49:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1117ac3f-4d5c-4e41-b25e-80b7490c9543 tempest-TestStampPattern-392278876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:49:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1117ac3f-4d5c-4e41-b25e-80b7490c9543 tempest-TestStampPattern-392278876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:49:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1117ac3f-4d5c-4e41-b25e-80b7490c9543 tempest-TestStampPattern-392278876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:49:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1117ac3f-4d5c-4e41-b25e-80b7490c9543 tempest-TestStampPattern-392278876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:49:57 devstack sudo[101437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:49:57 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:49:57 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root
Nov 05 09:49:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1117ac3f-4d5c-4e41-b25e-80b7490c9543 tempest-TestStampPattern-392278876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.261s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:49:57 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-1117ac3f-4d5c-4e41-b25e-80b7490c9543 tempest-TestStampPattern-392278876 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:49:57 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-1117ac3f-4d5c-4e41-b25e-80b7490c9543 tempest-TestStampPattern-392278876 None] Deleted volume successfully.
Nov 05 09:49:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1117ac3f-4d5c-4e41-b25e-80b7490c9543 tempest-TestStampPattern-392278876 None] Lock "cinder-c971751a-ac28-46fc-9d9c-f01c7a21a0ac-delete_volume" released by "delete_volume" :: held 1.156s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:50:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:50:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:50:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:50:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:50:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:50:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:50:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:50:00 devstack sudo[101444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:50:00 devstack sudo[101444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:50:00 devstack sudo[101444]: pam_unix(sudo:session): session closed for user root
Nov 05 09:50:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.253s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:50:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:50:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:50:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 28 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:50:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>, <Thread(tpool_thread_0, started daemon 132223357408960)>, <Thread(tpool_thread_1, started daemon 132223349016256)>, <Thread(tpool_thread_2, started daemon 132223340623552)>, <Thread(tpool_thread_3, started daemon 132223332230848)>, <Thread(tpool_thread_4, started daemon 132223323838144)>, <Thread(tpool_thread_5, started daemon 132223315445440)>, <Thread(tpool_thread_6, started daemon 132223307052736)>, <Thread(tpool_thread_7, started daemon 132223298660032)>, <Thread(tpool_thread_8, started daemon 132223290250944)>, <Thread(tpool_thread_9, started daemon 132223281841856)>, <Thread(tpool_thread_10, started daemon 132223273432768)>, <Thread(tpool_thread_11, started daemon 132223265023680)>, <Thread(tpool_thread_12, started daemon 132223256614592)>, <Thread(tpool_thread_13, started daemon 132223248205504)>, <Thread(tpool_thread_14, started daemon 132223239796416)>, <Thread(tpool_thread_15, started daemon 132223231387328)>, <Thread(tpool_thread_16, started daemon 132223222978240)>, <Thread(tpool_thread_17, started daemon 132223214569152)>, <Thread(tpool_thread_18, started daemon 132223206160064)>, <Thread(tpool_thread_19, started daemon 132223197750976)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:50:07 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=7,cinder:SELECT=4,cinder:INSERT=2 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:50:07 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:50:13 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:50:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Flow 'volume_create_manager' (cb46920d-b586-4d03-9730-23f95c86a67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:50:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e39e6a2-c29f-4af2-bb4b-c75458e00649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:50:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e39e6a2-c29f-4af2-bb4b-c75458e00649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ba790af-f513-441c-bdf9-a7328eb12ff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a48b2e1e1e3543be81d2fb565494fd00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:50:14Z,use_quota=True,user_id='019d418cc6ff4679b4cff54b718cd84a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fdce2911-30dd-4c5d-9158-d0d912678d15),volume_type_id=fdce2911-30dd-4c5d-9158-d0d912678d15)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:50:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ec87c92-ede5-4ffd-923a-878d26e447a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:50:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ec87c92-ede5-4ffd-923a-878d26e447a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:50:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd3486b-2b54-43b9-b1fe-6ed58cd8f3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:50:13 devstack cinder-volume[86649]: DEBUG cinder.image.glance [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Creating Keystone auth plugin from conf {{(pid=86649) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 09:50:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd3486b-2b54-43b9-b1fe-6ed58cd8f3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2ba790af-f513-441c-bdf9-a7328eb12ff3', 'volume_name': 'volume-2ba790af-f513-441c-bdf9-a7328eb12ff3', 'volume_size': 1, 'image_id': 'bb8bd54c-4fdd-454b-a4fd-4702365264c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb8bd54c-4fdd-454b-a4fd-4702365264c3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2fc987d6e497d0d694dbf6b3ff91d6d2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a48b2e1e1e3543be81d2fb565494fd00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ecff5dff12e2f356722dcef2edc26002e030435aba7a38b1bc7f9336f4ec38f956a5a1781d0519b38cb561cf2867dfc83422b513f7c1180e8ce8184701d4ad29', 'id': 'bb8bd54c-4fdd-454b-a4fd-4702365264c3', 'created_at': datetime.datetime(2026, 11, 5, 8, 50, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 8, 50, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb8bd54c-4fdd-454b-a4fd-4702365264c3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7841a6f04b90>}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:50:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d9adb3-fc6f-4b0d-be8e-ac21e2399692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:50:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d9adb3-fc6f-4b0d-be8e-ac21e2399692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:50:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1e22636-b894-465c-828d-8327978e6870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:50:13 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Volume 2ba790af-f513-441c-bdf9-a7328eb12ff3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2ba790af-f513-441c-bdf9-a7328eb12ff3', 'volume_size': 1, 'image_id': 'bb8bd54c-4fdd-454b-a4fd-4702365264c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb8bd54c-4fdd-454b-a4fd-4702365264c3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2fc987d6e497d0d694dbf6b3ff91d6d2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a48b2e1e1e3543be81d2fb565494fd00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ecff5dff12e2f356722dcef2edc26002e030435aba7a38b1bc7f9336f4ec38f956a5a1781d0519b38cb561cf2867dfc83422b513f7c1180e8ce8184701d4ad29', 'id': 'bb8bd54c-4fdd-454b-a4fd-4702365264c3', 'created_at': datetime.datetime(2026, 11, 5, 8, 50, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 8, 50, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb8bd54c-4fdd-454b-a4fd-4702365264c3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7841a6f04b90>}
Nov 05 09:50:13 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Trying to clone 2ba790af-f513-441c-bdf9-a7328eb12ff3 from image bb8bd54c-4fdd-454b-a4fd-4702365264c3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bb8bd54c-4fdd-454b-a4fd-4702365264c3', 'metadata': {}}]). {{(pid=86649) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 09:50:14 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bb8bd54c-4fdd-454b-a4fd-4702365264c3_vpa0siccdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 09:50:14 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 09:50:14 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8564ac8-66e0-4b52-acda-241c29f430ff]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:50:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bb8bd54c-4fdd-454b-a4fd-4702365264c3_vpa0siccdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:50:14 devstack sudo[101452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bb8bd54c-4fdd-454b-a4fd-4702365264c3_vpa0siccdevstack@QuobyteHD
Nov 05 09:50:14 devstack sudo[101452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:50:14 devstack sudo[101452]: pam_unix(sudo:session): session closed for user root
Nov 05 09:50:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bb8bd54c-4fdd-454b-a4fd-4702365264c3_vpa0siccdevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:50:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb8bd54c-4fdd-454b-a4fd-4702365264c3_vpa0siccdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:50:14 devstack sudo[101456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb8bd54c-4fdd-454b-a4fd-4702365264c3_vpa0siccdevstack@QuobyteHD
Nov 05 09:50:14 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:50:14 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root
Nov 05 09:50:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb8bd54c-4fdd-454b-a4fd-4702365264c3_vpa0siccdevstack@QuobyteHD" returned: 1 in 0.323s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:50:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb8bd54c-4fdd-454b-a4fd-4702365264c3_vpa0siccdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 09:50:14 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Temporary image bb8bd54c-4fdd-454b-a4fd-4702365264c3 is fetched for user 019d418cc6ff4679b4cff54b718cd84a. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 09:50:14 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5e7443-ba9f-43dd-8234-9a87ffa2da51]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:50:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bb8bd54c-4fdd-454b-a4fd-4702365264c3_vpa0siccdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:50:15 devstack sudo[101461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bb8bd54c-4fdd-454b-a4fd-4702365264c3_vpa0siccdevstack@QuobyteHD
Nov 05 09:50:15 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:50:15 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root
Nov 05 09:50:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bb8bd54c-4fdd-454b-a4fd-4702365264c3_vpa0siccdevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:50:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb8bd54c-4fdd-454b-a4fd-4702365264c3_vpa0siccdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:50:15 devstack sudo[101466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb8bd54c-4fdd-454b-a4fd-4702365264c3_vpa0siccdevstack@QuobyteHD
Nov 05 09:50:15 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:50:15 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root
Nov 05 09:50:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb8bd54c-4fdd-454b-a4fd-4702365264c3_vpa0siccdevstack@QuobyteHD" returned: 1 in 0.337s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:50:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb8bd54c-4fdd-454b-a4fd-4702365264c3_vpa0siccdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 09:50:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:50:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:50:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ba790af-f513-441c-bdf9-a7328eb12ff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a48b2e1e1e3543be81d2fb565494fd00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:50:14Z,use_quota=True,user_id='019d418cc6ff4679b4cff54b718cd84a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fdce2911-30dd-4c5d-9158-d0d912678d15),volume_type_id=fdce2911-30dd-4c5d-9158-d0d912678d15)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:50:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Creating volume 2ba790af-f513-441c-bdf9-a7328eb12ff3 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:50:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:50:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:50:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:50:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:50:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:50:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:50:15 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:50:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2ba790af-f513-441c-bdf9-a7328eb12ff3 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:50:15 devstack sudo[101471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2ba790af-f513-441c-bdf9-a7328eb12ff3 1073741824
Nov 05 09:50:15 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:50:15 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root
Nov 05 09:50:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2ba790af-f513-441c-bdf9-a7328eb12ff3 1073741824" returned: 0 in 0.409s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:50:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2ba790af-f513-441c-bdf9-a7328eb12ff3 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:50:16 devstack sudo[101476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2ba790af-f513-441c-bdf9-a7328eb12ff3
Nov 05 09:50:16 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:50:16 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root
Nov 05 09:50:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2ba790af-f513-441c-bdf9-a7328eb12ff3" returned: 0 in 0.288s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:50:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:50:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:50:16 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Attempting download of bb8bd54c-4fdd-454b-a4fd-4702365264c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/bb8bd54c-4fdd-454b-a4fd-4702365264c3', 'metadata': {}}])) to volume 2ba790af-f513-441c-bdf9-a7328eb12ff3. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 09:50:16 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0239cd3-83dd-4f5c-a74d-7138b0f812f8]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:50:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb8bd54c-4fdd-454b-a4fd-4702365264c3_s4byktz1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:50:16 devstack sudo[101484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb8bd54c-4fdd-454b-a4fd-4702365264c3_s4byktz1
Nov 05 09:50:16 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:50:16 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root
Nov 05 09:50:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb8bd54c-4fdd-454b-a4fd-4702365264c3_s4byktz1" returned: 0 in 0.339s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:50:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb8bd54c-4fdd-454b-a4fd-4702365264c3_s4byktz1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:50:16 devstack sudo[101491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb8bd54c-4fdd-454b-a4fd-4702365264c3_s4byktz1
Nov 05 09:50:16 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:50:17 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root
Nov 05 09:50:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb8bd54c-4fdd-454b-a4fd-4702365264c3_s4byktz1" returned: 1 in 0.339s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:50:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb8bd54c-4fdd-454b-a4fd-4702365264c3_s4byktz1' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 09:50:17 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[54120a40-d7e3-4fad-a238-bb4075ab737b]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:50:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bb8bd54c-4fdd-454b-a4fd-4702365264c3_vpa0siccdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:50:17 devstack sudo[101495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bb8bd54c-4fdd-454b-a4fd-4702365264c3_vpa0siccdevstack@QuobyteHD
Nov 05 09:50:17 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:50:17 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root
Nov 05 09:50:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bb8bd54c-4fdd-454b-a4fd-4702365264c3_vpa0siccdevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:50:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb8bd54c-4fdd-454b-a4fd-4702365264c3_vpa0siccdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:50:17 devstack sudo[101499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb8bd54c-4fdd-454b-a4fd-4702365264c3_vpa0siccdevstack@QuobyteHD
Nov 05 09:50:17 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:50:17 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root
Nov 05 09:50:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb8bd54c-4fdd-454b-a4fd-4702365264c3_vpa0siccdevstack@QuobyteHD" returned: 1 in 0.326s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:50:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb8bd54c-4fdd-454b-a4fd-4702365264c3_vpa0siccdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 09:50:17 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] bb8bd54c-4fdd-454b-a4fd-4702365264c3 was raw, converting to qcow2 {{(pid=86649) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 09:50:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bb8bd54c-4fdd-454b-a4fd-4702365264c3_vpa0siccdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2ba790af-f513-441c-bdf9-a7328eb12ff3 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:50:17 devstack sudo[101504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bb8bd54c-4fdd-454b-a4fd-4702365264c3_vpa0siccdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2ba790af-f513-441c-bdf9-a7328eb12ff3
Nov 05 09:50:17 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:50:18 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root
Nov 05 09:50:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bb8bd54c-4fdd-454b-a4fd-4702365264c3_vpa0siccdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2ba790af-f513-441c-bdf9-a7328eb12ff3" returned: 0 in 0.433s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bb8bd54c-4fdd-454b-a4fd-4702365264c3_vpa0siccdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2ba790af-f513-441c-bdf9-a7328eb12ff3 {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 09:50:18 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 09:50:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2ba790af-f513-441c-bdf9-a7328eb12ff3 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:50:18 devstack sudo[101509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2ba790af-f513-441c-bdf9-a7328eb12ff3 1G
Nov 05 09:50:18 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:50:18 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root
Nov 05 09:50:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2ba790af-f513-441c-bdf9-a7328eb12ff3 1G" returned: 0 in 0.299s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Downloaded image bb8bd54c-4fdd-454b-a4fd-4702365264c3 ((None, [{'url': 'file:///opt/stack/data/glance/images/bb8bd54c-4fdd-454b-a4fd-4702365264c3', 'metadata': {}}])) to volume 2ba790af-f513-441c-bdf9-a7328eb12ff3 successfully. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Temporary image bb8bd54c-4fdd-454b-a4fd-4702365264c3 for user 019d418cc6ff4679b4cff54b718cd84a is deleted. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Marking volume 2ba790af-f513-441c-bdf9-a7328eb12ff3 as bootable. {{(pid=86649) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Copying metadata from image bb8bd54c-4fdd-454b-a4fd-4702365264c3 to 2ba790af-f513-441c-bdf9-a7328eb12ff3. {{(pid=86649) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Creating volume glance metadata for volume 2ba790af-f513-441c-bdf9-a7328eb12ff3 backed by image bb8bd54c-4fdd-454b-a4fd-4702365264c3 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'bb8bd54c-4fdd-454b-a4fd-4702365264c3', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '2fc987d6e497d0d694dbf6b3ff91d6d2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86649) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1e22636-b894-465c-828d-8327978e6870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ba790af-f513-441c-bdf9-a7328eb12ff3', 'volume_size': 1, 'image_id': 'bb8bd54c-4fdd-454b-a4fd-4702365264c3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb8bd54c-4fdd-454b-a4fd-4702365264c3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2fc987d6e497d0d694dbf6b3ff91d6d2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a48b2e1e1e3543be81d2fb565494fd00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ecff5dff12e2f356722dcef2edc26002e030435aba7a38b1bc7f9336f4ec38f956a5a1781d0519b38cb561cf2867dfc83422b513f7c1180e8ce8184701d4ad29', 'id': 'bb8bd54c-4fdd-454b-a4fd-4702365264c3', 'created_at': datetime.datetime(2026, 11, 5, 8, 50, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 8, 50, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb8bd54c-4fdd-454b-a4fd-4702365264c3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7841a6f04b90>}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11bc5ad1-d944-4927-9f49-122463b95ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:50:18 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Volume volume-2ba790af-f513-441c-bdf9-a7328eb12ff3 (2ba790af-f513-441c-bdf9-a7328eb12ff3): created successfully
Nov 05 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11bc5ad1-d944-4927-9f49-122463b95ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Flow 'volume_create_manager' (cb46920d-b586-4d03-9730-23f95c86a67f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:50:18 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-d5cb4031-a1e0-40bd-932b-686db5e4085f tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Created volume successfully.
Nov 05 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-41ae96c8-2601-456f-bc6d-9bb08bbf5a64 tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Acquiring lock "cinder-2ba790af-f513-441c-bdf9-a7328eb12ff3-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-41ae96c8-2601-456f-bc6d-9bb08bbf5a64 tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Lock "cinder-2ba790af-f513-441c-bdf9-a7328eb12ff3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-41ae96c8-2601-456f-bc6d-9bb08bbf5a64 tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Acquiring lock "cinder-quobyte-2ba790af-f513-441c-bdf9-a7328eb12ff3" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:50:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-41ae96c8-2601-456f-bc6d-9bb08bbf5a64 tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Lock "cinder-quobyte-2ba790af-f513-441c-bdf9-a7328eb12ff3" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:50:18 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3cb2e5-8e93-4588-b1db-873cb1f2986d]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:50:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-41ae96c8-2601-456f-bc6d-9bb08bbf5a64 tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2ba790af-f513-441c-bdf9-a7328eb12ff3 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:50:19 devstack sudo[101514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2ba790af-f513-441c-bdf9-a7328eb12ff3
Nov 05 09:50:19 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:50:19 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root
Nov 05 09:50:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-41ae96c8-2601-456f-bc6d-9bb08bbf5a64 tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2ba790af-f513-441c-bdf9-a7328eb12ff3" returned: 0 in 0.371s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:50:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-41ae96c8-2601-456f-bc6d-9bb08bbf5a64 tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2ba790af-f513-441c-bdf9-a7328eb12ff3 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:50:19 devstack sudo[101519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2ba790af-f513-441c-bdf9-a7328eb12ff3
Nov 05 09:50:19 devstack sudo[101519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:50:19 devstack sudo[101519]: pam_unix(sudo:session): session closed for user root
Nov 05 09:50:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-41ae96c8-2601-456f-bc6d-9bb08bbf5a64 tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2ba790af-f513-441c-bdf9-a7328eb12ff3" returned: 0 in 0.249s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-41ae96c8-2601-456f-bc6d-9bb08bbf5a64 tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Lock "cinder-quobyte-2ba790af-f513-441c-bdf9-a7328eb12ff3" released by "delete_volume" :: held 0.661s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:50:19 devstack cinder-volume[86649]: WARNING cinder.quota [None req-41ae96c8-2601-456f-bc6d-9bb08bbf5a64 tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 05 09:50:19 devstack cinder-volume[86649]: WARNING cinder.quota [None req-41ae96c8-2601-456f-bc6d-9bb08bbf5a64 tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 05 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-41ae96c8-2601-456f-bc6d-9bb08bbf5a64 tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Created reservations ['2363dc5a-b1ea-4bf5-864f-d9cd224b031b', 'd21f9fb0-4b7b-4a65-a00c-0a2f2a54e2ce', '76437b8d-e569-48da-a1f6-6f1692f8d738', 'cacb534a-1a2b-498f-9bbc-c54843b707d0'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:50:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-41ae96c8-2601-456f-bc6d-9bb08bbf5a64 tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:50:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-41ae96c8-2601-456f-bc6d-9bb08bbf5a64 tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-41ae96c8-2601-456f-bc6d-9bb08bbf5a64 tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-41ae96c8-2601-456f-bc6d-9bb08bbf5a64 tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:50:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-41ae96c8-2601-456f-bc6d-9bb08bbf5a64 tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:50:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-41ae96c8-2601-456f-bc6d-9bb08bbf5a64 tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:50:19 devstack sudo[101523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:50:19 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:50:19 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root
Nov 05 09:50:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-41ae96c8-2601-456f-bc6d-9bb08bbf5a64 tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.263s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:50:19 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-41ae96c8-2601-456f-bc6d-9bb08bbf5a64 tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:50:19 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-41ae96c8-2601-456f-bc6d-9bb08bbf5a64 tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Deleted volume successfully.
Nov 05 09:50:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-41ae96c8-2601-456f-bc6d-9bb08bbf5a64 tempest-VolumeAndVolumeTypeFromImageTest-2017541421 None] Lock "cinder-2ba790af-f513-441c-bdf9-a7328eb12ff3-delete_volume" released by "delete_volume" :: held 1.129s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:50:29 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=9,cinder:SELECT=14,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:50:29 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=12,cinder:UPDATE=16,cinder:INSERT=9,cinder:DELETE=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] Flow 'volume_create_manager' (6127aaa9-cd66-4996-a3fa-ff4a7992e4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (464668bc-fe4b-491d-8c46-93440fca89ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (464668bc-fe4b-491d-8c46-93440fca89ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1585028304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0113ab1-611c-426c-a852-b454aebce419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a00c39970854c97962738ec39b896bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:50:50Z,use_quota=True,user_id='fbc7ca52dc58408c95839f19feb00241',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22b91f50-ebac-42de-bbde-6dfbfc6ff615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22b91f50-ebac-42de-bbde-6dfbfc6ff615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb23aad-9576-487b-a136-6fe40f82297e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb23aad-9576-487b-a136-6fe40f82297e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0113ab1-611c-426c-a852-b454aebce419', 'volume_name': 'volume-a0113ab1-611c-426c-a852-b454aebce419', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9723564-1368-4e6f-bf84-5dbbb6272df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9723564-1368-4e6f-bf84-5dbbb6272df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1660e221-e65f-4649-b528-bee2d83cd378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:50:50 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] Volume a0113ab1-611c-426c-a852-b454aebce419: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0113ab1-611c-426c-a852-b454aebce419', 'volume_size': 1}
Nov 05 09:50:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:50:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1585028304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0113ab1-611c-426c-a852-b454aebce419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a00c39970854c97962738ec39b896bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:50:50Z,use_quota=True,user_id='fbc7ca52dc58408c95839f19feb00241',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] Creating volume a0113ab1-611c-426c-a852-b454aebce419 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:50:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:50:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:50:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:50:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:50:50 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:50:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:50:50 devstack sudo[101574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419 1073741824
Nov 05 09:50:50 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:50:50 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root
Nov 05 09:50:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419 1073741824" returned: 0 in 0.445s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:50:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:50:50 devstack sudo[101579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419
Nov 05 09:50:50 devstack sudo[101579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:50:51 devstack sudo[101579]: pam_unix(sudo:session): session closed for user root
Nov 05 09:50:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419" returned: 0 in 0.250s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:50:51 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:50:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:50:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1660e221-e65f-4649-b528-bee2d83cd378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0113ab1-611c-426c-a852-b454aebce419', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:50:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (726504d2-d153-42e0-8ba4-2c941ee75f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:50:51 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] Volume volume-a0113ab1-611c-426c-a852-b454aebce419 (a0113ab1-611c-426c-a852-b454aebce419): created successfully
Nov 05 09:50:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (726504d2-d153-42e0-8ba4-2c941ee75f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:50:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] Flow 'volume_create_manager' (6127aaa9-cd66-4996-a3fa-ff4a7992e4c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:50:51 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-19c14a53-0076-4917-9e85-fe8e4b1e355a tempest-SnapshotDependencyTests-1572136687 None] Created volume successfully.
Nov 05 09:50:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-57e90168-f3b0-4c5b-a3b8-84e318bf0446 tempest-SnapshotDependencyTests-1572136687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:50:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-57e90168-f3b0-4c5b-a3b8-84e318bf0446 tempest-SnapshotDependencyTests-1572136687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:50:51 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-57e90168-f3b0-4c5b-a3b8-84e318bf0446 tempest-SnapshotDependencyTests-1572136687 None] Creating offline snapshot 5a7b4eab-aae9-4b96-b4ac-d4587eccca2b of volume a0113ab1-611c-426c-a852-b454aebce419 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 09:50:51 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ea90c5-41ba-4d94-bd5f-1951393d4256]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:50:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-57e90168-f3b0-4c5b-a3b8-84e318bf0446 tempest-SnapshotDependencyTests-1572136687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:50:51 devstack sudo[101582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419
Nov 05 09:50:51 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:50:51 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root
Nov 05 09:50:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-57e90168-f3b0-4c5b-a3b8-84e318bf0446 tempest-SnapshotDependencyTests-1572136687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419" returned: 0 in 0.379s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:50:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-57e90168-f3b0-4c5b-a3b8-84e318bf0446 tempest-SnapshotDependencyTests-1572136687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419.5a7b4eab-aae9-4b96-b4ac-d4587eccca2b 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:50:52 devstack sudo[101587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419.5a7b4eab-aae9-4b96-b4ac-d4587eccca2b 1G
Nov 05 09:50:52 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:50:52 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root
Nov 05 09:50:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-57e90168-f3b0-4c5b-a3b8-84e318bf0446 tempest-SnapshotDependencyTests-1572136687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419.5a7b4eab-aae9-4b96-b4ac-d4587eccca2b 1G" returned: 0 in 0.398s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:50:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-57e90168-f3b0-4c5b-a3b8-84e318bf0446 tempest-SnapshotDependencyTests-1572136687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0113ab1-611c-426c-a852-b454aebce419 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419.5a7b4eab-aae9-4b96-b4ac-d4587eccca2b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:50:52 devstack sudo[101592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0113ab1-611c-426c-a852-b454aebce419 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419.5a7b4eab-aae9-4b96-b4ac-d4587eccca2b
Nov 05 09:50:52 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:50:52 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root
Nov 05 09:50:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-57e90168-f3b0-4c5b-a3b8-84e318bf0446 tempest-SnapshotDependencyTests-1572136687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0113ab1-611c-426c-a852-b454aebce419 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419.5a7b4eab-aae9-4b96-b4ac-d4587eccca2b" returned: 0 in 0.296s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:50:52 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-57e90168-f3b0-4c5b-a3b8-84e318bf0446 tempest-SnapshotDependencyTests-1572136687 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419.5a7b4eab-aae9-4b96-b4ac-d4587eccca2b is being set with open permissions: ugo+rw
Nov 05 09:50:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-57e90168-f3b0-4c5b-a3b8-84e318bf0446 tempest-SnapshotDependencyTests-1572136687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419.5a7b4eab-aae9-4b96-b4ac-d4587eccca2b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:50:52 devstack sudo[101597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419.5a7b4eab-aae9-4b96-b4ac-d4587eccca2b
Nov 05 09:50:52 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:50:52 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root
Nov 05 09:50:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-57e90168-f3b0-4c5b-a3b8-84e318bf0446 tempest-SnapshotDependencyTests-1572136687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419.5a7b4eab-aae9-4b96-b4ac-d4587eccca2b" returned: 0 in 0.254s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:50:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-57e90168-f3b0-4c5b-a3b8-84e318bf0446 tempest-SnapshotDependencyTests-1572136687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:50:52 devstack sudo[101600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419.info
Nov 05 09:50:52 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:50:53 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root
Nov 05 09:50:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-57e90168-f3b0-4c5b-a3b8-84e318bf0446 tempest-SnapshotDependencyTests-1572136687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419.info" returned: 0 in 0.269s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:50:53 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-57e90168-f3b0-4c5b-a3b8-84e318bf0446 tempest-SnapshotDependencyTests-1572136687 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419.info is being set with open permissions: ugo+rw
Nov 05 09:50:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-57e90168-f3b0-4c5b-a3b8-84e318bf0446 tempest-SnapshotDependencyTests-1572136687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:50:53 devstack sudo[101603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419.info
Nov 05 09:50:53 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:50:53 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root
Nov 05 09:50:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-57e90168-f3b0-4c5b-a3b8-84e318bf0446 tempest-SnapshotDependencyTests-1572136687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419.info" returned: 0 in 0.251s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:50:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-57e90168-f3b0-4c5b-a3b8-84e318bf0446 tempest-SnapshotDependencyTests-1572136687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.932s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:50:53 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-57e90168-f3b0-4c5b-a3b8-84e318bf0446 tempest-SnapshotDependencyTests-1572136687 None] Create snapshot completed successfully
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Flow 'volume_create_manager' (df3c87b7-2458-4874-aaf8-274867c5f31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b1a17c6-d97b-403a-a8d1-ac007a4ab88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b1a17c6-d97b-403a-a8d1-ac007a4ab88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35bfc678-9de9-471d-ab2b-2d77cbe09276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a00c39970854c97962738ec39b896bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5a7b4eab-aae9-4b96-b4ac-d4587eccca2b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:50:54Z,use_quota=True,user_id='fbc7ca52dc58408c95839f19feb00241',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03171732-9411-42d1-8f8e-53d687f228cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03171732-9411-42d1-8f8e-53d687f228cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d61c3f34-cbde-4588-b928-cd4a69266c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d61c3f34-cbde-4588-b928-cd4a69266c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '35bfc678-9de9-471d-ab2b-2d77cbe09276', 'volume_name': 'volume-35bfc678-9de9-471d-ab2b-2d77cbe09276', 'volume_size': 1, 'snapshot_id': '5a7b4eab-aae9-4b96-b4ac-d4587eccca2b'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0b21210-6477-4016-9e09-58a8e0e2e5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0b21210-6477-4016-9e09-58a8e0e2e5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec4ea1e0-8acf-4484-9693-f581b73b732f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:50:54 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Volume 35bfc678-9de9-471d-ab2b-2d77cbe09276: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-35bfc678-9de9-471d-ab2b-2d77cbe09276', 'volume_size': 1, 'snapshot_id': '5a7b4eab-aae9-4b96-b4ac-d4587eccca2b'}
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Acquiring lock "cinder-quobyte-5a7b4eab-aae9-4b96-b4ac-d4587eccca2b-35bfc678-9de9-471d-ab2b-2d77cbe09276" by "_create_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Lock "cinder-quobyte-5a7b4eab-aae9-4b96-b4ac-d4587eccca2b-35bfc678-9de9-471d-ab2b-2d77cbe09276" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Creating volume 35bfc678-9de9-471d-ab2b-2d77cbe09276 from snapshot 5a7b4eab-aae9-4b96-b4ac-d4587eccca2b {{(pid=86649) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Acquiring lock "cinder-quobyte-35bfc678-9de9-471d-ab2b-2d77cbe09276" by "_copy_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Lock "cinder-quobyte-35bfc678-9de9-471d-ab2b-2d77cbe09276" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] snapshot: 5a7b4eab-aae9-4b96-b4ac-d4587eccca2b, volume: 35bfc678-9de9-471d-ab2b-2d77cbe09276,  {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7710e47-4b88-4fd2-8c92-ea1ef46cd254]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419.5a7b4eab-aae9-4b96-b4ac-d4587eccca2b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:50:54 devstack sudo[101606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419.5a7b4eab-aae9-4b96-b4ac-d4587eccca2b
Nov 05 09:50:54 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:50:54 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419.5a7b4eab-aae9-4b96-b4ac-d4587eccca2b" returned: 0 in 0.382s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0113ab1-611c-426c-a852-b454aebce419(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fd46f7-2842-4db3-8798-e13cbac1d342]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:50:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:50:54 devstack sudo[101611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419
Nov 05 09:50:54 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:50:55 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root
Nov 05 09:50:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419" returned: 0 in 0.370s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:50:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419 {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 09:50:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Creating direct copy from snapshot {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 09:50:55 devstack cinder-volume[86649]: DEBUG cinder.utils [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Path /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-35bfc678-9de9-471d-ab2b-2d77cbe09276 not found in is_blk_device check {{(pid=86649) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 09:50:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-35bfc678-9de9-471d-ab2b-2d77cbe09276 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:50:55 devstack sudo[101616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-35bfc678-9de9-471d-ab2b-2d77cbe09276
Nov 05 09:50:55 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:51:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:51:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:51:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:51:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:51:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:51:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:51:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:51:00 devstack sudo[101631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:51:00 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:51:00 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root
Nov 05 09:51:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.341s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:51:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:51:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:51:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 28 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:51:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>, <Thread(tpool_thread_0, started daemon 132223357408960)>, <Thread(tpool_thread_1, started daemon 132223349016256)>, <Thread(tpool_thread_2, started daemon 132223340623552)>, <Thread(tpool_thread_3, started daemon 132223332230848)>, <Thread(tpool_thread_4, started daemon 132223323838144)>, <Thread(tpool_thread_5, started daemon 132223315445440)>, <Thread(tpool_thread_6, started daemon 132223307052736)>, <Thread(tpool_thread_7, started daemon 132223298660032)>, <Thread(tpool_thread_8, started daemon 132223290250944)>, <Thread(tpool_thread_9, started daemon 132223281841856)>, <Thread(tpool_thread_10, started daemon 132223273432768)>, <Thread(tpool_thread_11, started daemon 132223265023680)>, <Thread(tpool_thread_12, started daemon 132223256614592)>, <Thread(tpool_thread_13, started daemon 132223248205504)>, <Thread(tpool_thread_14, started daemon 132223239796416)>, <Thread(tpool_thread_15, started daemon 132223231387328)>, <Thread(tpool_thread_16, started daemon 132223222978240)>, <Thread(tpool_thread_17, started daemon 132223214569152)>, <Thread(tpool_thread_18, started daemon 132223206160064)>, <Thread(tpool_thread_19, started daemon 132223197750976)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:51:01 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root
Nov 05 09:51:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-35bfc678-9de9-471d-ab2b-2d77cbe09276" returned: 0 in 6.363s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:51:01 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Image conversion details: src /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419, size 1024.00 MB, duration 6.36 sec, destination /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-35bfc678-9de9-471d-ab2b-2d77cbe09276 {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 09:51:01 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Converted 1024.00 MB image at 160.90 MB/s
Nov 05 09:51:01 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-35bfc678-9de9-471d-ab2b-2d77cbe09276 is being set with open permissions: ugo+rw
Nov 05 09:51:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-35bfc678-9de9-471d-ab2b-2d77cbe09276 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:51:01 devstack sudo[101634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-35bfc678-9de9-471d-ab2b-2d77cbe09276
Nov 05 09:51:01 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:51:01 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root
Nov 05 09:51:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-35bfc678-9de9-471d-ab2b-2d77cbe09276" returned: 0 in 0.260s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:51:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Lock "cinder-quobyte-35bfc678-9de9-471d-ab2b-2d77cbe09276" released by "_copy_volume_from_snapshot" :: held 7.468s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:51:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Lock "cinder-quobyte-5a7b4eab-aae9-4b96-b4ac-d4587eccca2b-35bfc678-9de9-471d-ab2b-2d77cbe09276" released by "_create_volume_from_snapshot" :: held 7.540s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:51:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.559s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:51:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec4ea1e0-8acf-4484-9693-f581b73b732f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35bfc678-9de9-471d-ab2b-2d77cbe09276', 'volume_size': 1, 'snapshot_id': '5a7b4eab-aae9-4b96-b4ac-d4587eccca2b'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:51:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc74f5de-6b4f-463a-90e9-70ffe0da205d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:51:01 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Volume volume-35bfc678-9de9-471d-ab2b-2d77cbe09276 (35bfc678-9de9-471d-ab2b-2d77cbe09276): created successfully
Nov 05 09:51:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc74f5de-6b4f-463a-90e9-70ffe0da205d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:51:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Flow 'volume_create_manager' (df3c87b7-2458-4874-aaf8-274867c5f31c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:51:01 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-54e49cd1-8dc3-4db2-9609-a2462ee571c0 tempest-SnapshotDependencyTests-1572136687 None] Created volume successfully.
Nov 05 09:51:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e3f34584-6080-4cde-9551-e39c3ab65cfe tempest-SnapshotDependencyTests-1572136687 None] Acquiring lock "cinder-5a7b4eab-aae9-4b96-b4ac-d4587eccca2b-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:51:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e3f34584-6080-4cde-9551-e39c3ab65cfe tempest-SnapshotDependencyTests-1572136687 None] Lock "cinder-5a7b4eab-aae9-4b96-b4ac-d4587eccca2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:51:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e3f34584-6080-4cde-9551-e39c3ab65cfe tempest-SnapshotDependencyTests-1572136687 None] Acquiring lock "cinder-quobyte-a0113ab1-611c-426c-a852-b454aebce419" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:51:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e3f34584-6080-4cde-9551-e39c3ab65cfe tempest-SnapshotDependencyTests-1572136687 None] Lock "cinder-quobyte-a0113ab1-611c-426c-a852-b454aebce419" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:51:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e3f34584-6080-4cde-9551-e39c3ab65cfe tempest-SnapshotDependencyTests-1572136687 None] Acquiring lock "cinder-quobyte-5a7b4eab-aae9-4b96-b4ac-d4587eccca2b" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:51:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e3f34584-6080-4cde-9551-e39c3ab65cfe tempest-SnapshotDependencyTests-1572136687 None] Lock "cinder-quobyte-5a7b4eab-aae9-4b96-b4ac-d4587eccca2b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:51:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-e3f34584-6080-4cde-9551-e39c3ab65cfe tempest-SnapshotDependencyTests-1572136687 None] Deleting offline snapshot 5a7b4eab-aae9-4b96-b4ac-d4587eccca2b of volume a0113ab1-611c-426c-a852-b454aebce419 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 09:51:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-e3f34584-6080-4cde-9551-e39c3ab65cfe tempest-SnapshotDependencyTests-1572136687 None] snapshot_file for this snap is: volume-a0113ab1-611c-426c-a852-b454aebce419.5a7b4eab-aae9-4b96-b4ac-d4587eccca2b {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 09:51:02 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00702a3-2e9b-4adc-862d-799fb8ef873e]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:51:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e3f34584-6080-4cde-9551-e39c3ab65cfe tempest-SnapshotDependencyTests-1572136687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419.5a7b4eab-aae9-4b96-b4ac-d4587eccca2b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:51:03 devstack sudo[101637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419.5a7b4eab-aae9-4b96-b4ac-d4587eccca2b
Nov 05 09:51:03 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:51:03 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root
Nov 05 09:51:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e3f34584-6080-4cde-9551-e39c3ab65cfe tempest-SnapshotDependencyTests-1572136687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419.5a7b4eab-aae9-4b96-b4ac-d4587eccca2b" returned: 0 in 0.368s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:51:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-e3f34584-6080-4cde-9551-e39c3ab65cfe tempest-SnapshotDependencyTests-1572136687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0113ab1-611c-426c-a852-b454aebce419(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:51:03 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[54894ebc-01a8-40b5-9bc8-b91cd70c1df2]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:51:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e3f34584-6080-4cde-9551-e39c3ab65cfe tempest-SnapshotDependencyTests-1572136687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:51:03 devstack sudo[101642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419
Nov 05 09:51:03 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:51:03 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root
Nov 05 09:51:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e3f34584-6080-4cde-9551-e39c3ab65cfe tempest-SnapshotDependencyTests-1572136687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419" returned: 0 in 0.508s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:51:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e3f34584-6080-4cde-9551-e39c3ab65cfe tempest-SnapshotDependencyTests-1572136687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419.5a7b4eab-aae9-4b96-b4ac-d4587eccca2b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:51:03 devstack sudo[101647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419.5a7b4eab-aae9-4b96-b4ac-d4587eccca2b
Nov 05 09:51:03 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:51:04 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root
Nov 05 09:51:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e3f34584-6080-4cde-9551-e39c3ab65cfe tempest-SnapshotDependencyTests-1572136687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419.5a7b4eab-aae9-4b96-b4ac-d4587eccca2b" returned: 0 in 0.364s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:51:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e3f34584-6080-4cde-9551-e39c3ab65cfe tempest-SnapshotDependencyTests-1572136687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419.5a7b4eab-aae9-4b96-b4ac-d4587eccca2b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:51:04 devstack sudo[101653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419.5a7b4eab-aae9-4b96-b4ac-d4587eccca2b
Nov 05 09:51:04 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:51:04 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root
Nov 05 09:51:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e3f34584-6080-4cde-9551-e39c3ab65cfe tempest-SnapshotDependencyTests-1572136687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419.5a7b4eab-aae9-4b96-b4ac-d4587eccca2b" returned: 0 in 0.243s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:51:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e3f34584-6080-4cde-9551-e39c3ab65cfe tempest-SnapshotDependencyTests-1572136687 None] Lock "cinder-quobyte-5a7b4eab-aae9-4b96-b4ac-d4587eccca2b" released by "_delete_snapshot" :: held 1.587s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:51:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e3f34584-6080-4cde-9551-e39c3ab65cfe tempest-SnapshotDependencyTests-1572136687 None] Lock "cinder-quobyte-a0113ab1-611c-426c-a852-b454aebce419" released by "delete_snapshot" :: held 1.616s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:51:04 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-e3f34584-6080-4cde-9551-e39c3ab65cfe tempest-SnapshotDependencyTests-1572136687 None] Created reservations ['150576a9-2a24-4cf9-ad8b-a3f20ca3bfdd', 'e3f2575a-b056-4bc5-b069-a9fb2491eeef', '03104f6f-fa1f-4c8f-b0f9-7cebe5a095fe', 'de363886-b612-45fd-a7ca-12e9d1c7bc6a'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:51:04 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-e3f34584-6080-4cde-9551-e39c3ab65cfe tempest-SnapshotDependencyTests-1572136687 None] Delete snapshot completed successfully.
Nov 05 09:51:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e3f34584-6080-4cde-9551-e39c3ab65cfe tempest-SnapshotDependencyTests-1572136687 None] Lock "cinder-5a7b4eab-aae9-4b96-b4ac-d4587eccca2b-delete_snapshot" released by "delete_snapshot" :: held 1.750s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:51:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f6ed6b35-e427-4a01-b465-49c5a2db14c9 tempest-SnapshotDependencyTests-1572136687 None] Acquiring lock "cinder-a0113ab1-611c-426c-a852-b454aebce419-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:51:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f6ed6b35-e427-4a01-b465-49c5a2db14c9 tempest-SnapshotDependencyTests-1572136687 None] Lock "cinder-a0113ab1-611c-426c-a852-b454aebce419-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:51:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f6ed6b35-e427-4a01-b465-49c5a2db14c9 tempest-SnapshotDependencyTests-1572136687 None] Acquiring lock "cinder-quobyte-a0113ab1-611c-426c-a852-b454aebce419" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:51:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f6ed6b35-e427-4a01-b465-49c5a2db14c9 tempest-SnapshotDependencyTests-1572136687 None] Lock "cinder-quobyte-a0113ab1-611c-426c-a852-b454aebce419" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:51:05 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe498a72-0425-44dd-9fba-e224c9b73c9c]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:51:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f6ed6b35-e427-4a01-b465-49c5a2db14c9 tempest-SnapshotDependencyTests-1572136687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:51:05 devstack sudo[101656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419
Nov 05 09:51:05 devstack sudo[101656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:51:05 devstack sudo[101656]: pam_unix(sudo:session): session closed for user root
Nov 05 09:51:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f6ed6b35-e427-4a01-b465-49c5a2db14c9 tempest-SnapshotDependencyTests-1572136687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419" returned: 0 in 0.358s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:51:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f6ed6b35-e427-4a01-b465-49c5a2db14c9 tempest-SnapshotDependencyTests-1572136687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:51:05 devstack sudo[101661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419
Nov 05 09:51:05 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:51:05 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root
Nov 05 09:51:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f6ed6b35-e427-4a01-b465-49c5a2db14c9 tempest-SnapshotDependencyTests-1572136687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a0113ab1-611c-426c-a852-b454aebce419" returned: 0 in 0.241s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:51:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f6ed6b35-e427-4a01-b465-49c5a2db14c9 tempest-SnapshotDependencyTests-1572136687 None] Lock "cinder-quobyte-a0113ab1-611c-426c-a852-b454aebce419" released by "delete_volume" :: held 0.660s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:51:05 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-f6ed6b35-e427-4a01-b465-49c5a2db14c9 tempest-SnapshotDependencyTests-1572136687 None] Created reservations ['b0e7c120-9968-459a-8fd0-9de84dbf5a62', '30b243ad-6b85-400d-8a83-628e3521bc4f', '804d453b-60ad-4619-a437-b519b30321b7', '55063689-98d2-4600-819e-539401c1b31c'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:51:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f6ed6b35-e427-4a01-b465-49c5a2db14c9 tempest-SnapshotDependencyTests-1572136687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:51:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f6ed6b35-e427-4a01-b465-49c5a2db14c9 tempest-SnapshotDependencyTests-1572136687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:51:05 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f6ed6b35-e427-4a01-b465-49c5a2db14c9 tempest-SnapshotDependencyTests-1572136687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:51:05 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f6ed6b35-e427-4a01-b465-49c5a2db14c9 tempest-SnapshotDependencyTests-1572136687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:51:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f6ed6b35-e427-4a01-b465-49c5a2db14c9 tempest-SnapshotDependencyTests-1572136687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:51:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f6ed6b35-e427-4a01-b465-49c5a2db14c9 tempest-SnapshotDependencyTests-1572136687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:51:05 devstack sudo[101664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:51:05 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:51:06 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root
Nov 05 09:51:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f6ed6b35-e427-4a01-b465-49c5a2db14c9 tempest-SnapshotDependencyTests-1572136687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.259s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:51:06 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-f6ed6b35-e427-4a01-b465-49c5a2db14c9 tempest-SnapshotDependencyTests-1572136687 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:51:06 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f6ed6b35-e427-4a01-b465-49c5a2db14c9 tempest-SnapshotDependencyTests-1572136687 None] Deleted volume successfully.
Nov 05 09:51:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f6ed6b35-e427-4a01-b465-49c5a2db14c9 tempest-SnapshotDependencyTests-1572136687 None] Lock "cinder-a0113ab1-611c-426c-a852-b454aebce419-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:51:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-304946c7-4b06-4aa7-82a7-afe49f544dbc tempest-SnapshotDependencyTests-1572136687 None] Acquiring lock "cinder-35bfc678-9de9-471d-ab2b-2d77cbe09276-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:51:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-304946c7-4b06-4aa7-82a7-afe49f544dbc tempest-SnapshotDependencyTests-1572136687 None] Lock "cinder-35bfc678-9de9-471d-ab2b-2d77cbe09276-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:51:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-304946c7-4b06-4aa7-82a7-afe49f544dbc tempest-SnapshotDependencyTests-1572136687 None] Acquiring lock "cinder-quobyte-35bfc678-9de9-471d-ab2b-2d77cbe09276" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:51:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-304946c7-4b06-4aa7-82a7-afe49f544dbc tempest-SnapshotDependencyTests-1572136687 None] Lock "cinder-quobyte-35bfc678-9de9-471d-ab2b-2d77cbe09276" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:51:06 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d301de46-36a4-4884-b770-c875a37338ca]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:51:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-304946c7-4b06-4aa7-82a7-afe49f544dbc tempest-SnapshotDependencyTests-1572136687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-35bfc678-9de9-471d-ab2b-2d77cbe09276 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:51:06 devstack sudo[101667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-35bfc678-9de9-471d-ab2b-2d77cbe09276
Nov 05 09:51:06 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:51:06 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root
Nov 05 09:51:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-304946c7-4b06-4aa7-82a7-afe49f544dbc tempest-SnapshotDependencyTests-1572136687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-35bfc678-9de9-471d-ab2b-2d77cbe09276" returned: 0 in 0.386s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:51:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-304946c7-4b06-4aa7-82a7-afe49f544dbc tempest-SnapshotDependencyTests-1572136687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-35bfc678-9de9-471d-ab2b-2d77cbe09276 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:51:06 devstack sudo[101673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-35bfc678-9de9-471d-ab2b-2d77cbe09276
Nov 05 09:51:06 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:51:06 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root
Nov 05 09:51:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-304946c7-4b06-4aa7-82a7-afe49f544dbc tempest-SnapshotDependencyTests-1572136687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-35bfc678-9de9-471d-ab2b-2d77cbe09276" returned: 0 in 0.257s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:51:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-304946c7-4b06-4aa7-82a7-afe49f544dbc tempest-SnapshotDependencyTests-1572136687 None] Lock "cinder-quobyte-35bfc678-9de9-471d-ab2b-2d77cbe09276" released by "delete_volume" :: held 0.684s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:51:07 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-304946c7-4b06-4aa7-82a7-afe49f544dbc tempest-SnapshotDependencyTests-1572136687 None] Created reservations ['30c5dcca-32f9-4bab-9811-85aa45e97110', '3ce28d54-e6f3-40d3-8ff8-72f2fe84f6db', 'dfc4fd7a-5b5e-4b8d-b735-a32a3fc336ed', 'fb8c88dc-98db-4918-92d0-24d36a6fc02d'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:51:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-304946c7-4b06-4aa7-82a7-afe49f544dbc tempest-SnapshotDependencyTests-1572136687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:51:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-304946c7-4b06-4aa7-82a7-afe49f544dbc tempest-SnapshotDependencyTests-1572136687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:51:07 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-304946c7-4b06-4aa7-82a7-afe49f544dbc tempest-SnapshotDependencyTests-1572136687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:51:07 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-304946c7-4b06-4aa7-82a7-afe49f544dbc tempest-SnapshotDependencyTests-1572136687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:51:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-304946c7-4b06-4aa7-82a7-afe49f544dbc tempest-SnapshotDependencyTests-1572136687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:51:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-304946c7-4b06-4aa7-82a7-afe49f544dbc tempest-SnapshotDependencyTests-1572136687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:51:07 devstack sudo[101676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:51:07 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:51:07 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root
Nov 05 09:51:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-304946c7-4b06-4aa7-82a7-afe49f544dbc tempest-SnapshotDependencyTests-1572136687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.252s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:51:07 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-304946c7-4b06-4aa7-82a7-afe49f544dbc tempest-SnapshotDependencyTests-1572136687 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:51:07 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-304946c7-4b06-4aa7-82a7-afe49f544dbc tempest-SnapshotDependencyTests-1572136687 None] Deleted volume successfully.
Nov 05 09:51:07 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-304946c7-4b06-4aa7-82a7-afe49f544dbc tempest-SnapshotDependencyTests-1572136687 None] Lock "cinder-35bfc678-9de9-471d-ab2b-2d77cbe09276-delete_volume" released by "delete_volume" :: held 1.130s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:51:17 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=25,cinder:INSERT=9,cinder:UPDATE=28,cinder:DELETE=3 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:51:17 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=25,cinder:UPDATE=31,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:52:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:52:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:52:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:52:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:52:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:52:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:52:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:52:00 devstack sudo[101742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:52:00 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:52:00 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root
Nov 05 09:52:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.259s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:52:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:52:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:52:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 28 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:52:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>, <Thread(tpool_thread_0, started daemon 132223357408960)>, <Thread(tpool_thread_1, started daemon 132223349016256)>, <Thread(tpool_thread_2, started daemon 132223340623552)>, <Thread(tpool_thread_3, started daemon 132223332230848)>, <Thread(tpool_thread_4, started daemon 132223323838144)>, <Thread(tpool_thread_5, started daemon 132223315445440)>, <Thread(tpool_thread_6, started daemon 132223307052736)>, <Thread(tpool_thread_7, started daemon 132223298660032)>, <Thread(tpool_thread_8, started daemon 132223290250944)>, <Thread(tpool_thread_9, started daemon 132223281841856)>, <Thread(tpool_thread_10, started daemon 132223273432768)>, <Thread(tpool_thread_11, started daemon 132223265023680)>, <Thread(tpool_thread_12, started daemon 132223256614592)>, <Thread(tpool_thread_13, started daemon 132223248205504)>, <Thread(tpool_thread_14, started daemon 132223239796416)>, <Thread(tpool_thread_15, started daemon 132223231387328)>, <Thread(tpool_thread_16, started daemon 132223222978240)>, <Thread(tpool_thread_17, started daemon 132223214569152)>, <Thread(tpool_thread_18, started daemon 132223206160064)>, <Thread(tpool_thread_19, started daemon 132223197750976)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:53:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:53:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:53:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:53:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:53:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:53:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:53:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:53:00 devstack sudo[101808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:53:00 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:53:00 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root
Nov 05 09:53:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.317s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:53:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:53:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:53:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 28 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:53:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>, <Thread(tpool_thread_0, started daemon 132223357408960)>, <Thread(tpool_thread_1, started daemon 132223349016256)>, <Thread(tpool_thread_2, started daemon 132223340623552)>, <Thread(tpool_thread_3, started daemon 132223332230848)>, <Thread(tpool_thread_4, started daemon 132223323838144)>, <Thread(tpool_thread_5, started daemon 132223315445440)>, <Thread(tpool_thread_6, started daemon 132223307052736)>, <Thread(tpool_thread_7, started daemon 132223298660032)>, <Thread(tpool_thread_8, started daemon 132223290250944)>, <Thread(tpool_thread_9, started daemon 132223281841856)>, <Thread(tpool_thread_10, started daemon 132223273432768)>, <Thread(tpool_thread_11, started daemon 132223265023680)>, <Thread(tpool_thread_12, started daemon 132223256614592)>, <Thread(tpool_thread_13, started daemon 132223248205504)>, <Thread(tpool_thread_14, started daemon 132223239796416)>, <Thread(tpool_thread_15, started daemon 132223231387328)>, <Thread(tpool_thread_16, started daemon 132223222978240)>, <Thread(tpool_thread_17, started daemon 132223214569152)>, <Thread(tpool_thread_18, started daemon 132223206160064)>, <Thread(tpool_thread_19, started daemon 132223197750976)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:53:06 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:53:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a4873256-a405-41bb-b393-c524b93c8a3c tempest-VolumesActionsTest-786279288 None] Acquiring lock "cinder-75575e25-c398-47c4-99a0-2228c2366dd7" by "attach_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:53:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a4873256-a405-41bb-b393-c524b93c8a3c tempest-VolumesActionsTest-786279288 None] Lock "cinder-75575e25-c398-47c4-99a0-2228c2366dd7" acquired by "attach_volume" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:53:09 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-a4873256-a405-41bb-b393-c524b93c8a3c tempest-VolumesActionsTest-786279288 None] Attaching volume 75575e25-c398-47c4-99a0-2228c2366dd7 to instance b6119eee-f087-4974-b58e-a8ad67cd03f0 at mountpoint /dev/vdb on host None.
Nov 05 09:53:09 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-a4873256-a405-41bb-b393-c524b93c8a3c tempest-VolumesActionsTest-786279288 None] Attach volume completed successfully.
Nov 05 09:53:09 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a4873256-a405-41bb-b393-c524b93c8a3c tempest-VolumesActionsTest-786279288 None] Lock "cinder-75575e25-c398-47c4-99a0-2228c2366dd7" released by "attach_volume" :: held 0.101s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:53:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f8a9d880-8916-4a17-b9de-80a678119566 tempest-VolumesActionsTest-786279288 None] Acquiring lock "cinder-75575e25-c398-47c4-99a0-2228c2366dd7-detach_volume" by "detach_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:53:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f8a9d880-8916-4a17-b9de-80a678119566 tempest-VolumesActionsTest-786279288 None] Lock "cinder-75575e25-c398-47c4-99a0-2228c2366dd7-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:53:10 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f8a9d880-8916-4a17-b9de-80a678119566 tempest-VolumesActionsTest-786279288 None] Detaching volume 75575e25-c398-47c4-99a0-2228c2366dd7 from instance b6119eee-f087-4974-b58e-a8ad67cd03f0.
Nov 05 09:53:10 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f8a9d880-8916-4a17-b9de-80a678119566 tempest-VolumesActionsTest-786279288 None] Detach volume completed successfully.
Nov 05 09:53:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f8a9d880-8916-4a17-b9de-80a678119566 tempest-VolumesActionsTest-786279288 None] Lock "cinder-75575e25-c398-47c4-99a0-2228c2366dd7-detach_volume" released by "detach_volume" :: held 0.061s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:53:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3e611ba1-7b42-42fc-abad-2894b1e0f5fe tempest-VolumesActionsTest-786279288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:53:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3e611ba1-7b42-42fc-abad-2894b1e0f5fe tempest-VolumesActionsTest-786279288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:53:14 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd12f1c-e7d2-4f5d-aa82-9bc78bb05fe8]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:53:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3e611ba1-7b42-42fc-abad-2894b1e0f5fe tempest-VolumesActionsTest-786279288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:53:14 devstack sudo[101947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7
Nov 05 09:53:14 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:53:14 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root
Nov 05 09:53:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3e611ba1-7b42-42fc-abad-2894b1e0f5fe tempest-VolumesActionsTest-786279288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7" returned: 0 in 0.376s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:53:14 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[a012dd80-03a1-4b55-a1a5-697af5d83c60]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:53:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3e611ba1-7b42-42fc-abad-2894b1e0f5fe tempest-VolumesActionsTest-786279288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:53:15 devstack sudo[101952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7
Nov 05 09:53:15 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:53:15 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root
Nov 05 09:53:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3e611ba1-7b42-42fc-abad-2894b1e0f5fe tempest-VolumesActionsTest-786279288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7" returned: 0 in 0.404s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:53:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3e611ba1-7b42-42fc-abad-2894b1e0f5fe tempest-VolumesActionsTest-786279288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7 /opt/stack/data/cinder/conversion/75575e25-c398-47c4-99a0-2228c2366dd7.temp_image.f0127b01-76bd-4ed4-a071-bea15ac74397bg6l2xqv.img {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:53:15 devstack sudo[101957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7 /opt/stack/data/cinder/conversion/75575e25-c398-47c4-99a0-2228c2366dd7.temp_image.f0127b01-76bd-4ed4-a071-bea15ac74397bg6l2xqv.img
Nov 05 09:53:15 devstack sudo[101957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:53:20 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:53:21 devstack sudo[101957]: pam_unix(sudo:session): session closed for user root
Nov 05 09:53:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3e611ba1-7b42-42fc-abad-2894b1e0f5fe tempest-VolumesActionsTest-786279288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7 /opt/stack/data/cinder/conversion/75575e25-c398-47c4-99a0-2228c2366dd7.temp_image.f0127b01-76bd-4ed4-a071-bea15ac74397bg6l2xqv.img" returned: 0 in 6.119s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:53:21 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3fae1c-7334-4211-af02-6ff4d160d76e]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:53:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3e611ba1-7b42-42fc-abad-2894b1e0f5fe tempest-VolumesActionsTest-786279288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:53:21 devstack sudo[101973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7
Nov 05 09:53:21 devstack sudo[101973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:53:21 devstack sudo[101973]: pam_unix(sudo:session): session closed for user root
Nov 05 09:53:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3e611ba1-7b42-42fc-abad-2894b1e0f5fe tempest-VolumesActionsTest-786279288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7" returned: 0 in 0.517s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:53:21 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-3e611ba1-7b42-42fc-abad-2894b1e0f5fe tempest-VolumesActionsTest-786279288 None] Image conversion details: src /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7, size 1024.00 MB, duration 6.12 sec, destination /opt/stack/data/cinder/conversion/75575e25-c398-47c4-99a0-2228c2366dd7.temp_image.f0127b01-76bd-4ed4-a071-bea15ac74397bg6l2xqv.img {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 09:53:21 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-3e611ba1-7b42-42fc-abad-2894b1e0f5fe tempest-VolumesActionsTest-786279288 None] Converted 1024.00 MB image at 167.33 MB/s
Nov 05 09:53:22 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-3e611ba1-7b42-42fc-abad-2894b1e0f5fe tempest-VolumesActionsTest-786279288 None] f0127b01-76bd-4ed4-a071-bea15ac74397 was raw, no need to convert to raw {{(pid=86649) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 05 09:53:32 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:53:32 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=10,cinder:INSERT=2,cinder:UPDATE=3 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:53:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3e611ba1-7b42-42fc-abad-2894b1e0f5fe tempest-VolumesActionsTest-786279288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.277s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:53:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3e611ba1-7b42-42fc-abad-2894b1e0f5fe tempest-VolumesActionsTest-786279288 None] Uploaded volume to glance image-id: f0127b01-76bd-4ed4-a071-bea15ac74397. {{(pid=86649) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 05 09:53:40 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-3e611ba1-7b42-42fc-abad-2894b1e0f5fe tempest-VolumesActionsTest-786279288 None] Copy volume to image completed successfully.
Nov 05 09:53:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-411353d4-da20-4341-b4ef-2aa0f70b4b79 tempest-VolumesActionsTest-786279288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:53:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-411353d4-da20-4341-b4ef-2aa0f70b4b79 tempest-VolumesActionsTest-786279288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:53:42 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7bad16-37c2-407e-a799-49bf5cbd0500]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:53:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-411353d4-da20-4341-b4ef-2aa0f70b4b79 tempest-VolumesActionsTest-786279288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:53:42 devstack sudo[101990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7
Nov 05 09:53:42 devstack sudo[101990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:53:42 devstack sudo[101990]: pam_unix(sudo:session): session closed for user root
Nov 05 09:53:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-411353d4-da20-4341-b4ef-2aa0f70b4b79 tempest-VolumesActionsTest-786279288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7" returned: 0 in 0.369s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:53:42 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57b2053-35cd-47db-bfd1-6a60bf91b52a]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:53:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-411353d4-da20-4341-b4ef-2aa0f70b4b79 tempest-VolumesActionsTest-786279288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:53:42 devstack sudo[101995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7
Nov 05 09:53:42 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:53:43 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root
Nov 05 09:53:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-411353d4-da20-4341-b4ef-2aa0f70b4b79 tempest-VolumesActionsTest-786279288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7" returned: 0 in 0.367s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:53:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-411353d4-da20-4341-b4ef-2aa0f70b4b79 tempest-VolumesActionsTest-786279288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7 /opt/stack/data/cinder/conversion/75575e25-c398-47c4-99a0-2228c2366dd7.temp_image.659d0e36-afa1-43b9-81d9-ced65d787838e8tntphw.img {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:53:43 devstack sudo[102000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7 /opt/stack/data/cinder/conversion/75575e25-c398-47c4-99a0-2228c2366dd7.temp_image.659d0e36-afa1-43b9-81d9-ced65d787838e8tntphw.img
Nov 05 09:53:43 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:53:49 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root
Nov 05 09:53:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-411353d4-da20-4341-b4ef-2aa0f70b4b79 tempest-VolumesActionsTest-786279288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7 /opt/stack/data/cinder/conversion/75575e25-c398-47c4-99a0-2228c2366dd7.temp_image.659d0e36-afa1-43b9-81d9-ced65d787838e8tntphw.img" returned: 0 in 6.053s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:53:49 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[761120fc-f450-4108-a93a-4879cf9bd0f4]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:53:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-411353d4-da20-4341-b4ef-2aa0f70b4b79 tempest-VolumesActionsTest-786279288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:53:49 devstack sudo[102049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7
Nov 05 09:53:49 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:53:49 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root
Nov 05 09:53:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-411353d4-da20-4341-b4ef-2aa0f70b4b79 tempest-VolumesActionsTest-786279288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7" returned: 0 in 0.516s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:53:49 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-411353d4-da20-4341-b4ef-2aa0f70b4b79 tempest-VolumesActionsTest-786279288 None] Image conversion details: src /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7, size 1024.00 MB, duration 6.05 sec, destination /opt/stack/data/cinder/conversion/75575e25-c398-47c4-99a0-2228c2366dd7.temp_image.659d0e36-afa1-43b9-81d9-ced65d787838e8tntphw.img {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 09:53:49 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-411353d4-da20-4341-b4ef-2aa0f70b4b79 tempest-VolumesActionsTest-786279288 None] Converted 1024.00 MB image at 169.14 MB/s
Nov 05 09:53:49 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-411353d4-da20-4341-b4ef-2aa0f70b4b79 tempest-VolumesActionsTest-786279288 None] 659d0e36-afa1-43b9-81d9-ced65d787838 was raw, converting to qcow2 {{(pid=86649) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Nov 05 09:53:49 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5893e82-42d5-439d-a1bd-31659dd6716c]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:53:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-411353d4-da20-4341-b4ef-2aa0f70b4b79 tempest-VolumesActionsTest-786279288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/75575e25-c398-47c4-99a0-2228c2366dd7.temp_image.659d0e36-afa1-43b9-81d9-ced65d787838e8tntphw.img {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:53:49 devstack sudo[102055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/75575e25-c398-47c4-99a0-2228c2366dd7.temp_image.659d0e36-afa1-43b9-81d9-ced65d787838e8tntphw.img
Nov 05 09:53:49 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:53:50 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root
Nov 05 09:53:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-411353d4-da20-4341-b4ef-2aa0f70b4b79 tempest-VolumesActionsTest-786279288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/75575e25-c398-47c4-99a0-2228c2366dd7.temp_image.659d0e36-afa1-43b9-81d9-ced65d787838e8tntphw.img" returned: 0 in 0.329s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:53:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-411353d4-da20-4341-b4ef-2aa0f70b4b79 tempest-VolumesActionsTest-786279288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/75575e25-c398-47c4-99a0-2228c2366dd7.temp_image.659d0e36-afa1-43b9-81d9-ced65d787838e8tntphw.img {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:53:50 devstack sudo[102059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/75575e25-c398-47c4-99a0-2228c2366dd7.temp_image.659d0e36-afa1-43b9-81d9-ced65d787838e8tntphw.img
Nov 05 09:53:50 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:53:50 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root
Nov 05 09:53:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-411353d4-da20-4341-b4ef-2aa0f70b4b79 tempest-VolumesActionsTest-786279288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/75575e25-c398-47c4-99a0-2228c2366dd7.temp_image.659d0e36-afa1-43b9-81d9-ced65d787838e8tntphw.img" returned: 1 in 0.320s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:53:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-411353d4-da20-4341-b4ef-2aa0f70b4b79 tempest-VolumesActionsTest-786279288 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/75575e25-c398-47c4-99a0-2228c2366dd7.temp_image.659d0e36-afa1-43b9-81d9-ced65d787838e8tntphw.img' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 09:53:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-411353d4-da20-4341-b4ef-2aa0f70b4b79 tempest-VolumesActionsTest-786279288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/75575e25-c398-47c4-99a0-2228c2366dd7.temp_image.659d0e36-afa1-43b9-81d9-ced65d787838e8tntphw.img /opt/stack/data/cinder/conversion/vol_upload_u7wyge_5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:53:50 devstack sudo[102064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/75575e25-c398-47c4-99a0-2228c2366dd7.temp_image.659d0e36-afa1-43b9-81d9-ced65d787838e8tntphw.img /opt/stack/data/cinder/conversion/vol_upload_u7wyge_5
Nov 05 09:53:50 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:53:50 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root
Nov 05 09:53:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-411353d4-da20-4341-b4ef-2aa0f70b4b79 tempest-VolumesActionsTest-786279288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/75575e25-c398-47c4-99a0-2228c2366dd7.temp_image.659d0e36-afa1-43b9-81d9-ced65d787838e8tntphw.img /opt/stack/data/cinder/conversion/vol_upload_u7wyge_5" returned: 0 in 0.257s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:53:50 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-411353d4-da20-4341-b4ef-2aa0f70b4b79 tempest-VolumesActionsTest-786279288 None] Image conversion details: src /opt/stack/data/cinder/conversion/75575e25-c398-47c4-99a0-2228c2366dd7.temp_image.659d0e36-afa1-43b9-81d9-ced65d787838e8tntphw.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_u7wyge_5 {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 09:53:50 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-411353d4-da20-4341-b4ef-2aa0f70b4b79 tempest-VolumesActionsTest-786279288 None] Converted 1024.00 MB image at 1024.00 MB/s
Nov 05 09:53:50 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[be138f61-bd86-4ce4-8172-7ba5ab552c8c]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:53:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-411353d4-da20-4341-b4ef-2aa0f70b4b79 tempest-VolumesActionsTest-786279288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_u7wyge_5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:53:50 devstack sudo[102069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_u7wyge_5
Nov 05 09:53:50 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:53:50 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root
Nov 05 09:53:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-411353d4-da20-4341-b4ef-2aa0f70b4b79 tempest-VolumesActionsTest-786279288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_u7wyge_5" returned: 0 in 0.329s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:53:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-411353d4-da20-4341-b4ef-2aa0f70b4b79 tempest-VolumesActionsTest-786279288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.885s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:53:52 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-411353d4-da20-4341-b4ef-2aa0f70b4b79 tempest-VolumesActionsTest-786279288 None] Uploaded volume to glance image-id: 659d0e36-afa1-43b9-81d9-ced65d787838. {{(pid=86649) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 05 09:53:52 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-411353d4-da20-4341-b4ef-2aa0f70b4b79 tempest-VolumesActionsTest-786279288 None] Copy volume to image completed successfully.
Nov 05 09:53:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8d577154-aa49-4948-a1c6-78a016207cad tempest-VolumesActionsTest-786279288 None] Acquiring lock "cinder-75575e25-c398-47c4-99a0-2228c2366dd7-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:53:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8d577154-aa49-4948-a1c6-78a016207cad tempest-VolumesActionsTest-786279288 None] Lock "cinder-75575e25-c398-47c4-99a0-2228c2366dd7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:53:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8d577154-aa49-4948-a1c6-78a016207cad tempest-VolumesActionsTest-786279288 None] Acquiring lock "cinder-quobyte-75575e25-c398-47c4-99a0-2228c2366dd7" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:53:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8d577154-aa49-4948-a1c6-78a016207cad tempest-VolumesActionsTest-786279288 None] Lock "cinder-quobyte-75575e25-c398-47c4-99a0-2228c2366dd7" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:53:53 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cad296a-6cd1-43fd-9d07-c0be626f35b3]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:53:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8d577154-aa49-4948-a1c6-78a016207cad tempest-VolumesActionsTest-786279288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:53:53 devstack sudo[102074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7
Nov 05 09:53:53 devstack sudo[102074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:53:53 devstack sudo[102074]: pam_unix(sudo:session): session closed for user root
Nov 05 09:53:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8d577154-aa49-4948-a1c6-78a016207cad tempest-VolumesActionsTest-786279288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7" returned: 0 in 0.366s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:53:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8d577154-aa49-4948-a1c6-78a016207cad tempest-VolumesActionsTest-786279288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:53:53 devstack sudo[102079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7
Nov 05 09:53:53 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:53:54 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root
Nov 05 09:53:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8d577154-aa49-4948-a1c6-78a016207cad tempest-VolumesActionsTest-786279288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-75575e25-c398-47c4-99a0-2228c2366dd7" returned: 0 in 0.245s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:53:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8d577154-aa49-4948-a1c6-78a016207cad tempest-VolumesActionsTest-786279288 None] Lock "cinder-quobyte-75575e25-c398-47c4-99a0-2228c2366dd7" released by "delete_volume" :: held 0.649s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:53:54 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-8d577154-aa49-4948-a1c6-78a016207cad tempest-VolumesActionsTest-786279288 None] Created reservations ['2df69cdd-38ed-4dc0-a897-44edca6dffb7', '3867b8cb-6af2-4d3d-b715-44bcd55ce6ba', '6dc0fb9c-2d67-477b-99f9-769243f2517a', '38b85788-5619-4414-bf39-88f9efe159d2'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:53:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8d577154-aa49-4948-a1c6-78a016207cad tempest-VolumesActionsTest-786279288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:53:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8d577154-aa49-4948-a1c6-78a016207cad tempest-VolumesActionsTest-786279288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:53:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8d577154-aa49-4948-a1c6-78a016207cad tempest-VolumesActionsTest-786279288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:53:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8d577154-aa49-4948-a1c6-78a016207cad tempest-VolumesActionsTest-786279288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:53:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8d577154-aa49-4948-a1c6-78a016207cad tempest-VolumesActionsTest-786279288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:53:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8d577154-aa49-4948-a1c6-78a016207cad tempest-VolumesActionsTest-786279288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:53:54 devstack sudo[102082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:53:54 devstack sudo[102082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:53:54 devstack sudo[102082]: pam_unix(sudo:session): session closed for user root
Nov 05 09:53:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8d577154-aa49-4948-a1c6-78a016207cad tempest-VolumesActionsTest-786279288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.251s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:53:54 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-8d577154-aa49-4948-a1c6-78a016207cad tempest-VolumesActionsTest-786279288 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:53:54 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-8d577154-aa49-4948-a1c6-78a016207cad tempest-VolumesActionsTest-786279288 None] Deleted volume successfully.
Nov 05 09:53:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8d577154-aa49-4948-a1c6-78a016207cad tempest-VolumesActionsTest-786279288 None] Lock "cinder-75575e25-c398-47c4-99a0-2228c2366dd7-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:54:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:54:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:54:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:54:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:54:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:54:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:54:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:00 devstack sudo[102088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:54:00 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:54:00 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root
Nov 05 09:54:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.273s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:54:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:54:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 28 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:54:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>, <Thread(tpool_thread_0, started daemon 132223357408960)>, <Thread(tpool_thread_1, started daemon 132223349016256)>, <Thread(tpool_thread_2, started daemon 132223340623552)>, <Thread(tpool_thread_3, started daemon 132223332230848)>, <Thread(tpool_thread_4, started daemon 132223323838144)>, <Thread(tpool_thread_5, started daemon 132223315445440)>, <Thread(tpool_thread_6, started daemon 132223307052736)>, <Thread(tpool_thread_7, started daemon 132223298660032)>, <Thread(tpool_thread_8, started daemon 132223290250944)>, <Thread(tpool_thread_9, started daemon 132223281841856)>, <Thread(tpool_thread_10, started daemon 132223273432768)>, <Thread(tpool_thread_11, started daemon 132223265023680)>, <Thread(tpool_thread_12, started daemon 132223256614592)>, <Thread(tpool_thread_13, started daemon 132223248205504)>, <Thread(tpool_thread_14, started daemon 132223239796416)>, <Thread(tpool_thread_15, started daemon 132223231387328)>, <Thread(tpool_thread_16, started daemon 132223222978240)>, <Thread(tpool_thread_17, started daemon 132223214569152)>, <Thread(tpool_thread_18, started daemon 132223206160064)>, <Thread(tpool_thread_19, started daemon 132223197750976)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:54:02 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:54:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Flow 'volume_create_manager' (2da01714-19cc-458f-a2de-208f4950c2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:54:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f231df7-85ab-47b6-90e6-022e04148c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:54:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f231df7-85ab-47b6-90e6-022e04148c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1084771282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eb75c42-be20-4744-9f2a-afbe2d087f31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='712413770a0c48ec942eb6f7d0f515fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:54:03Z,use_quota=True,user_id='5753b7a9fa3d4b01a420b42c9aa00e94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:54:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ea7b76-143f-494a-9021-7ef3c977b6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:54:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ea7b76-143f-494a-9021-7ef3c977b6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:54:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12da8872-9705-4ade-b160-609e7088eb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:54:02 devstack cinder-volume[86649]: DEBUG cinder.image.glance [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Creating Keystone auth plugin from conf {{(pid=86649) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 09:54:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12da8872-9705-4ade-b160-609e7088eb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0eb75c42-be20-4744-9f2a-afbe2d087f31', 'volume_name': 'volume-0eb75c42-be20-4744-9f2a-afbe2d087f31', 'volume_size': 1, 'image_id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ccc0fd9-02f4-4820-84b7-775604485a72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '407fc75c86be40efb1fcfded98df545b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'created_at': datetime.datetime(2026, 11, 5, 8, 20, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 8, 20, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ccc0fd9-02f4-4820-84b7-775604485a72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7841a6fdd100>}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:54:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2415ff13-bb6d-4d2f-a035-e9f50554835a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:54:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2415ff13-bb6d-4d2f-a035-e9f50554835a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:54:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e63e810e-dcfd-482f-be39-4310563ae332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:54:02 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Volume 0eb75c42-be20-4744-9f2a-afbe2d087f31: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0eb75c42-be20-4744-9f2a-afbe2d087f31', 'volume_size': 1, 'image_id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ccc0fd9-02f4-4820-84b7-775604485a72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '407fc75c86be40efb1fcfded98df545b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'created_at': datetime.datetime(2026, 11, 5, 8, 20, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 8, 20, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ccc0fd9-02f4-4820-84b7-775604485a72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7841a6fdd100>}
Nov 05 09:54:02 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Trying to clone 0eb75c42-be20-4744-9f2a-afbe2d087f31 from image 7ccc0fd9-02f4-4820-84b7-775604485a72 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7ccc0fd9-02f4-4820-84b7-775604485a72', 'metadata': {}}]). {{(pid=86649) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 09:54:03 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_u4zdjwt4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 09:54:03 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 09:54:03 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75b0c50-cfc6-4ed6-b57b-bd2d76ab915d]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:54:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_u4zdjwt4devstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:03 devstack sudo[102092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_u4zdjwt4devstack@QuobyteHD
Nov 05 09:54:03 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:54:03 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root
Nov 05 09:54:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_u4zdjwt4devstack@QuobyteHD" returned: 0 in 0.342s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:03 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Temporary image 7ccc0fd9-02f4-4820-84b7-775604485a72 is fetched for user 5753b7a9fa3d4b01a420b42c9aa00e94. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 09:54:03 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[092d09d1-855d-4ec3-a443-4df8e1726402]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:54:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_u4zdjwt4devstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:03 devstack sudo[102097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_u4zdjwt4devstack@QuobyteHD
Nov 05 09:54:03 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:54:04 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root
Nov 05 09:54:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_u4zdjwt4devstack@QuobyteHD" returned: 0 in 0.332s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:54:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:54:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1084771282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eb75c42-be20-4744-9f2a-afbe2d087f31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='712413770a0c48ec942eb6f7d0f515fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:54:03Z,use_quota=True,user_id='5753b7a9fa3d4b01a420b42c9aa00e94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:54:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Creating volume 0eb75c42-be20-4744-9f2a-afbe2d087f31 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:54:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:54:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:54:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:54:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:54:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:54:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:54:04 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:54:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0eb75c42-be20-4744-9f2a-afbe2d087f31 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:04 devstack sudo[102102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0eb75c42-be20-4744-9f2a-afbe2d087f31 1073741824
Nov 05 09:54:04 devstack sudo[102102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:54:04 devstack sudo[102102]: pam_unix(sudo:session): session closed for user root
Nov 05 09:54:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0eb75c42-be20-4744-9f2a-afbe2d087f31 1073741824" returned: 0 in 0.432s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0eb75c42-be20-4744-9f2a-afbe2d087f31 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:04 devstack sudo[102108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0eb75c42-be20-4744-9f2a-afbe2d087f31
Nov 05 09:54:04 devstack sudo[102108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:54:04 devstack sudo[102108]: pam_unix(sudo:session): session closed for user root
Nov 05 09:54:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0eb75c42-be20-4744-9f2a-afbe2d087f31" returned: 0 in 0.244s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:54:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:54:04 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Attempting download of 7ccc0fd9-02f4-4820-84b7-775604485a72 ((None, [{'url': 'file:///opt/stack/data/glance/images/7ccc0fd9-02f4-4820-84b7-775604485a72', 'metadata': {}}])) to volume 0eb75c42-be20-4744-9f2a-afbe2d087f31. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 09:54:04 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a6086b-39a5-4928-b587-9eef3801d88a]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:54:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_cdl0ob6o {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:04 devstack sudo[102111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_cdl0ob6o
Nov 05 09:54:04 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:54:05 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root
Nov 05 09:54:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_cdl0ob6o" returned: 0 in 0.320s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_cdl0ob6o {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:05 devstack sudo[102115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_cdl0ob6o
Nov 05 09:54:05 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:54:05 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root
Nov 05 09:54:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_cdl0ob6o" returned: 1 in 0.320s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ccc0fd9-02f4-4820-84b7-775604485a72_cdl0ob6o' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 09:54:05 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fe7d54-f338-4183-baaf-cc7a52b88a5f]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:54:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_u4zdjwt4devstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:05 devstack sudo[102119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_u4zdjwt4devstack@QuobyteHD
Nov 05 09:54:05 devstack sudo[102119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:54:05 devstack sudo[102119]: pam_unix(sudo:session): session closed for user root
Nov 05 09:54:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_u4zdjwt4devstack@QuobyteHD" returned: 0 in 0.325s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:05 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] 7ccc0fd9-02f4-4820-84b7-775604485a72 was qcow2, converting to qcow2 {{(pid=86649) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 09:54:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_u4zdjwt4devstack@QuobyteHD /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0eb75c42-be20-4744-9f2a-afbe2d087f31 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:05 devstack sudo[102124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_u4zdjwt4devstack@QuobyteHD /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0eb75c42-be20-4744-9f2a-afbe2d087f31
Nov 05 09:54:05 devstack sudo[102124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:54:07 devstack sudo[102124]: pam_unix(sudo:session): session closed for user root
Nov 05 09:54:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_u4zdjwt4devstack@QuobyteHD /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0eb75c42-be20-4744-9f2a-afbe2d087f31" returned: 0 in 1.791s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:07 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7ccc0fd9-02f4-4820-84b7-775604485a72_u4zdjwt4devstack@QuobyteHD, size 112.00 MB, duration 1.79 sec, destination /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0eb75c42-be20-4744-9f2a-afbe2d087f31 {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 09:54:07 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Converted 112.00 MB image at 62.48 MB/s
Nov 05 09:54:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0eb75c42-be20-4744-9f2a-afbe2d087f31 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:07 devstack sudo[102133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0eb75c42-be20-4744-9f2a-afbe2d087f31 1G
Nov 05 09:54:07 devstack sudo[102133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:54:07 devstack sudo[102133]: pam_unix(sudo:session): session closed for user root
Nov 05 09:54:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0eb75c42-be20-4744-9f2a-afbe2d087f31 1G" returned: 0 in 0.334s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:07 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Downloaded image 7ccc0fd9-02f4-4820-84b7-775604485a72 ((None, [{'url': 'file:///opt/stack/data/glance/images/7ccc0fd9-02f4-4820-84b7-775604485a72', 'metadata': {}}])) to volume 0eb75c42-be20-4744-9f2a-afbe2d087f31 successfully. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 09:54:07 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Temporary image 7ccc0fd9-02f4-4820-84b7-775604485a72 for user 5753b7a9fa3d4b01a420b42c9aa00e94 is deleted. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 09:54:07 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Marking volume 0eb75c42-be20-4744-9f2a-afbe2d087f31 as bootable. {{(pid=86649) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 09:54:07 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Copying metadata from image 7ccc0fd9-02f4-4820-84b7-775604485a72 to 0eb75c42-be20-4744-9f2a-afbe2d087f31. {{(pid=86649) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 09:54:07 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Creating volume glance metadata for volume 0eb75c42-be20-4744-9f2a-afbe2d087f31 backed by image 7ccc0fd9-02f4-4820-84b7-775604485a72 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86649) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 09:54:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e63e810e-dcfd-482f-be39-4310563ae332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eb75c42-be20-4744-9f2a-afbe2d087f31', 'volume_size': 1, 'image_id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ccc0fd9-02f4-4820-84b7-775604485a72', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '407fc75c86be40efb1fcfded98df545b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ccc0fd9-02f4-4820-84b7-775604485a72', 'created_at': datetime.datetime(2026, 11, 5, 8, 20, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 8, 20, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ccc0fd9-02f4-4820-84b7-775604485a72/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7841a6fdd100>}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:54:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acd9b0bd-5da4-47b1-854b-0d6f0c6c9447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:54:08 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Volume volume-0eb75c42-be20-4744-9f2a-afbe2d087f31 (0eb75c42-be20-4744-9f2a-afbe2d087f31): created successfully
Nov 05 09:54:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acd9b0bd-5da4-47b1-854b-0d6f0c6c9447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:54:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Flow 'volume_create_manager' (2da01714-19cc-458f-a2de-208f4950c2b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:54:08 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f16c7486-71a3-4b05-90c3-2d0f36d8b53c tempest-VolumesExtendTest-460724001 None] Created volume successfully.
Nov 05 09:54:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3aae60e2-fdd6-4e32-80ac-bb8d4e74fddc tempest-VolumesExtendTest-460724001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:54:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3aae60e2-fdd6-4e32-80ac-bb8d4e74fddc tempest-VolumesExtendTest-460724001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:54:09 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afd891e-752d-45da-95b1-5fbf226245cc]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:54:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3aae60e2-fdd6-4e32-80ac-bb8d4e74fddc tempest-VolumesExtendTest-460724001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0eb75c42-be20-4744-9f2a-afbe2d087f31 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:09 devstack sudo[102138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0eb75c42-be20-4744-9f2a-afbe2d087f31
Nov 05 09:54:09 devstack sudo[102138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:54:09 devstack sudo[102138]: pam_unix(sudo:session): session closed for user root
Nov 05 09:54:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3aae60e2-fdd6-4e32-80ac-bb8d4e74fddc tempest-VolumesExtendTest-460724001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0eb75c42-be20-4744-9f2a-afbe2d087f31" returned: 0 in 0.380s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3aae60e2-fdd6-4e32-80ac-bb8d4e74fddc tempest-VolumesExtendTest-460724001 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0eb75c42-be20-4744-9f2a-afbe2d087f31 2G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3aae60e2-fdd6-4e32-80ac-bb8d4e74fddc tempest-VolumesExtendTest-460724001 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0eb75c42-be20-4744-9f2a-afbe2d087f31 2G" returned: 0 in 0.095s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3aae60e2-fdd6-4e32-80ac-bb8d4e74fddc tempest-VolumesExtendTest-460724001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.503s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:54:09 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-3aae60e2-fdd6-4e32-80ac-bb8d4e74fddc tempest-VolumesExtendTest-460724001 None] Extend volume completed successfully.
Nov 05 09:54:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fefb841f-5b75-440c-81c1-7a94ed647d1e tempest-VolumesExtendTest-460724001 None] Acquiring lock "cinder-0eb75c42-be20-4744-9f2a-afbe2d087f31-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:54:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fefb841f-5b75-440c-81c1-7a94ed647d1e tempest-VolumesExtendTest-460724001 None] Lock "cinder-0eb75c42-be20-4744-9f2a-afbe2d087f31-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:54:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fefb841f-5b75-440c-81c1-7a94ed647d1e tempest-VolumesExtendTest-460724001 None] Acquiring lock "cinder-quobyte-0eb75c42-be20-4744-9f2a-afbe2d087f31" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:54:10 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fefb841f-5b75-440c-81c1-7a94ed647d1e tempest-VolumesExtendTest-460724001 None] Lock "cinder-quobyte-0eb75c42-be20-4744-9f2a-afbe2d087f31" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:54:10 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[100ef643-4b87-4783-bad7-f93b26138634]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:54:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fefb841f-5b75-440c-81c1-7a94ed647d1e tempest-VolumesExtendTest-460724001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0eb75c42-be20-4744-9f2a-afbe2d087f31 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:10 devstack sudo[102148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0eb75c42-be20-4744-9f2a-afbe2d087f31
Nov 05 09:54:10 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:54:10 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root
Nov 05 09:54:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fefb841f-5b75-440c-81c1-7a94ed647d1e tempest-VolumesExtendTest-460724001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0eb75c42-be20-4744-9f2a-afbe2d087f31" returned: 0 in 0.354s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fefb841f-5b75-440c-81c1-7a94ed647d1e tempest-VolumesExtendTest-460724001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0eb75c42-be20-4744-9f2a-afbe2d087f31 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:11 devstack sudo[102153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0eb75c42-be20-4744-9f2a-afbe2d087f31
Nov 05 09:54:11 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:54:11 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root
Nov 05 09:54:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fefb841f-5b75-440c-81c1-7a94ed647d1e tempest-VolumesExtendTest-460724001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0eb75c42-be20-4744-9f2a-afbe2d087f31" returned: 0 in 0.249s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fefb841f-5b75-440c-81c1-7a94ed647d1e tempest-VolumesExtendTest-460724001 None] Lock "cinder-quobyte-0eb75c42-be20-4744-9f2a-afbe2d087f31" released by "delete_volume" :: held 0.643s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:54:11 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-fefb841f-5b75-440c-81c1-7a94ed647d1e tempest-VolumesExtendTest-460724001 None] Created reservations ['521f0399-a90e-4466-b386-1dc451106a37', 'c2f48f1c-def1-46ed-a946-10244ea315d0', '5534a7ab-0ade-49c8-a20a-922b4b87203d', '28443af5-e0c1-4141-9155-19ffa604a6bc'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:54:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fefb841f-5b75-440c-81c1-7a94ed647d1e tempest-VolumesExtendTest-460724001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:54:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fefb841f-5b75-440c-81c1-7a94ed647d1e tempest-VolumesExtendTest-460724001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:54:11 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fefb841f-5b75-440c-81c1-7a94ed647d1e tempest-VolumesExtendTest-460724001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:54:11 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fefb841f-5b75-440c-81c1-7a94ed647d1e tempest-VolumesExtendTest-460724001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:54:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fefb841f-5b75-440c-81c1-7a94ed647d1e tempest-VolumesExtendTest-460724001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:54:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fefb841f-5b75-440c-81c1-7a94ed647d1e tempest-VolumesExtendTest-460724001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:11 devstack sudo[102156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:54:11 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:54:11 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root
Nov 05 09:54:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fefb841f-5b75-440c-81c1-7a94ed647d1e tempest-VolumesExtendTest-460724001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.266s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:11 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-fefb841f-5b75-440c-81c1-7a94ed647d1e tempest-VolumesExtendTest-460724001 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:54:11 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-fefb841f-5b75-440c-81c1-7a94ed647d1e tempest-VolumesExtendTest-460724001 None] Deleted volume successfully.
Nov 05 09:54:11 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fefb841f-5b75-440c-81c1-7a94ed647d1e tempest-VolumesExtendTest-460724001 None] Lock "cinder-0eb75c42-be20-4744-9f2a-afbe2d087f31-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:54:12 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:54:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] Flow 'volume_create_manager' (41a42c73-a696-43cb-9a10-eabd7e8ad2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:54:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b2e75a-1e61-4d70-afec-cd3966db7d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:54:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b2e75a-1e61-4d70-afec-cd3966db7d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2052304963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da330219-08b3-4498-8361-b6eda8d3d1e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='712413770a0c48ec942eb6f7d0f515fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:54:12Z,use_quota=True,user_id='5753b7a9fa3d4b01a420b42c9aa00e94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:54:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2efe5f-e4ac-4a31-ba2d-f032b935388f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:54:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2efe5f-e4ac-4a31-ba2d-f032b935388f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:54:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b48ca70-03a7-4387-a210-2058fbd4d002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:54:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b48ca70-03a7-4387-a210-2058fbd4d002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da330219-08b3-4498-8361-b6eda8d3d1e1', 'volume_name': 'volume-da330219-08b3-4498-8361-b6eda8d3d1e1', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:54:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b21f08-23ed-4fb0-beab-20e89f7fbeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:54:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b21f08-23ed-4fb0-beab-20e89f7fbeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:54:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6542067-b11a-45d5-bbd7-3d64cd84581f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:54:12 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] Volume da330219-08b3-4498-8361-b6eda8d3d1e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da330219-08b3-4498-8361-b6eda8d3d1e1', 'volume_size': 1}
Nov 05 09:54:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:54:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:54:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2052304963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da330219-08b3-4498-8361-b6eda8d3d1e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='712413770a0c48ec942eb6f7d0f515fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:54:12Z,use_quota=True,user_id='5753b7a9fa3d4b01a420b42c9aa00e94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:54:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] Creating volume da330219-08b3-4498-8361-b6eda8d3d1e1 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:54:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:54:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:54:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:54:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:54:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:54:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:54:12 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:54:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:12 devstack sudo[102159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1 1073741824
Nov 05 09:54:12 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:54:12 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root
Nov 05 09:54:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1 1073741824" returned: 0 in 0.423s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:12 devstack sudo[102164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1
Nov 05 09:54:12 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:54:12 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root
Nov 05 09:54:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1" returned: 0 in 0.252s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:54:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:54:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6542067-b11a-45d5-bbd7-3d64cd84581f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da330219-08b3-4498-8361-b6eda8d3d1e1', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:54:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f521692b-34a9-4492-b326-ccee845b73b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:54:12 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] Volume volume-da330219-08b3-4498-8361-b6eda8d3d1e1 (da330219-08b3-4498-8361-b6eda8d3d1e1): created successfully
Nov 05 09:54:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f521692b-34a9-4492-b326-ccee845b73b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:54:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] Flow 'volume_create_manager' (41a42c73-a696-43cb-9a10-eabd7e8ad2b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:54:12 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-6260d960-c83a-4c52-96fd-30f656e375d1 tempest-VolumesExtendTest-460724001 None] Created volume successfully.
Nov 05 09:54:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4beb8c3c-ebe9-4cda-a791-7e294d488077 tempest-VolumesExtendTest-460724001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:54:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4beb8c3c-ebe9-4cda-a791-7e294d488077 tempest-VolumesExtendTest-460724001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:54:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-4beb8c3c-ebe9-4cda-a791-7e294d488077 tempest-VolumesExtendTest-460724001 None] Creating offline snapshot e55fc1e5-74a5-4c17-8c78-4211bf53d0fe of volume da330219-08b3-4498-8361-b6eda8d3d1e1 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 09:54:13 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[112b84b0-f363-489c-8ce2-ebf27c0fe588]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:54:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4beb8c3c-ebe9-4cda-a791-7e294d488077 tempest-VolumesExtendTest-460724001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:13 devstack sudo[102167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1
Nov 05 09:54:13 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:54:13 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root
Nov 05 09:54:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4beb8c3c-ebe9-4cda-a791-7e294d488077 tempest-VolumesExtendTest-460724001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1" returned: 0 in 0.357s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4beb8c3c-ebe9-4cda-a791-7e294d488077 tempest-VolumesExtendTest-460724001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1.e55fc1e5-74a5-4c17-8c78-4211bf53d0fe 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:13 devstack sudo[102172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1.e55fc1e5-74a5-4c17-8c78-4211bf53d0fe 1G
Nov 05 09:54:13 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:54:14 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root
Nov 05 09:54:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4beb8c3c-ebe9-4cda-a791-7e294d488077 tempest-VolumesExtendTest-460724001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1.e55fc1e5-74a5-4c17-8c78-4211bf53d0fe 1G" returned: 0 in 0.387s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4beb8c3c-ebe9-4cda-a791-7e294d488077 tempest-VolumesExtendTest-460724001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da330219-08b3-4498-8361-b6eda8d3d1e1 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1.e55fc1e5-74a5-4c17-8c78-4211bf53d0fe {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:14 devstack sudo[102177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da330219-08b3-4498-8361-b6eda8d3d1e1 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1.e55fc1e5-74a5-4c17-8c78-4211bf53d0fe
Nov 05 09:54:14 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:54:14 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root
Nov 05 09:54:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4beb8c3c-ebe9-4cda-a791-7e294d488077 tempest-VolumesExtendTest-460724001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da330219-08b3-4498-8361-b6eda8d3d1e1 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1.e55fc1e5-74a5-4c17-8c78-4211bf53d0fe" returned: 0 in 0.294s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:14 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-4beb8c3c-ebe9-4cda-a791-7e294d488077 tempest-VolumesExtendTest-460724001 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1.e55fc1e5-74a5-4c17-8c78-4211bf53d0fe is being set with open permissions: ugo+rw
Nov 05 09:54:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4beb8c3c-ebe9-4cda-a791-7e294d488077 tempest-VolumesExtendTest-460724001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1.e55fc1e5-74a5-4c17-8c78-4211bf53d0fe {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:14 devstack sudo[102182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1.e55fc1e5-74a5-4c17-8c78-4211bf53d0fe
Nov 05 09:54:14 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:54:14 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root
Nov 05 09:54:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4beb8c3c-ebe9-4cda-a791-7e294d488077 tempest-VolumesExtendTest-460724001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1.e55fc1e5-74a5-4c17-8c78-4211bf53d0fe" returned: 0 in 0.257s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4beb8c3c-ebe9-4cda-a791-7e294d488077 tempest-VolumesExtendTest-460724001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:14 devstack sudo[102185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1.info
Nov 05 09:54:14 devstack sudo[102185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:54:14 devstack sudo[102185]: pam_unix(sudo:session): session closed for user root
Nov 05 09:54:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4beb8c3c-ebe9-4cda-a791-7e294d488077 tempest-VolumesExtendTest-460724001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1.info" returned: 0 in 0.253s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:14 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-4beb8c3c-ebe9-4cda-a791-7e294d488077 tempest-VolumesExtendTest-460724001 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1.info is being set with open permissions: ugo+rw
Nov 05 09:54:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4beb8c3c-ebe9-4cda-a791-7e294d488077 tempest-VolumesExtendTest-460724001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:14 devstack sudo[102188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1.info
Nov 05 09:54:14 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:54:15 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root
Nov 05 09:54:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4beb8c3c-ebe9-4cda-a791-7e294d488077 tempest-VolumesExtendTest-460724001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1.info" returned: 0 in 0.242s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-4beb8c3c-ebe9-4cda-a791-7e294d488077 tempest-VolumesExtendTest-460724001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.877s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:54:15 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-4beb8c3c-ebe9-4cda-a791-7e294d488077 tempest-VolumesExtendTest-460724001 None] Create snapshot completed successfully
Nov 05 09:54:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d3f7c1d6-83b2-4405-99b1-cb8eab13cb0e tempest-VolumesExtendTest-460724001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:54:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d3f7c1d6-83b2-4405-99b1-cb8eab13cb0e tempest-VolumesExtendTest-460724001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:54:15 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ecc472-0c59-4c62-9f15-753bfc36bd51]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:54:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d3f7c1d6-83b2-4405-99b1-cb8eab13cb0e tempest-VolumesExtendTest-460724001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:15 devstack sudo[102191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1
Nov 05 09:54:15 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:54:15 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root
Nov 05 09:54:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d3f7c1d6-83b2-4405-99b1-cb8eab13cb0e tempest-VolumesExtendTest-460724001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1" returned: 0 in 0.386s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d3f7c1d6-83b2-4405-99b1-cb8eab13cb0e tempest-VolumesExtendTest-460724001 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1.e55fc1e5-74a5-4c17-8c78-4211bf53d0fe 2G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d3f7c1d6-83b2-4405-99b1-cb8eab13cb0e tempest-VolumesExtendTest-460724001 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1.e55fc1e5-74a5-4c17-8c78-4211bf53d0fe 2G" returned: 0 in 0.122s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d3f7c1d6-83b2-4405-99b1-cb8eab13cb0e tempest-VolumesExtendTest-460724001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.543s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:54:16 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-d3f7c1d6-83b2-4405-99b1-cb8eab13cb0e tempest-VolumesExtendTest-460724001 None] Extend volume completed successfully.
Nov 05 09:54:16 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-07b1054c-8aa2-4739-9c65-07ddde36ff42 tempest-VolumesExtendTest-460724001 None] Acquiring lock "cinder-e55fc1e5-74a5-4c17-8c78-4211bf53d0fe-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:54:16 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-07b1054c-8aa2-4739-9c65-07ddde36ff42 tempest-VolumesExtendTest-460724001 None] Lock "cinder-e55fc1e5-74a5-4c17-8c78-4211bf53d0fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:54:16 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-07b1054c-8aa2-4739-9c65-07ddde36ff42 tempest-VolumesExtendTest-460724001 None] Acquiring lock "cinder-quobyte-da330219-08b3-4498-8361-b6eda8d3d1e1" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:54:16 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-07b1054c-8aa2-4739-9c65-07ddde36ff42 tempest-VolumesExtendTest-460724001 None] Lock "cinder-quobyte-da330219-08b3-4498-8361-b6eda8d3d1e1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:54:16 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-07b1054c-8aa2-4739-9c65-07ddde36ff42 tempest-VolumesExtendTest-460724001 None] Acquiring lock "cinder-quobyte-e55fc1e5-74a5-4c17-8c78-4211bf53d0fe" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:54:16 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-07b1054c-8aa2-4739-9c65-07ddde36ff42 tempest-VolumesExtendTest-460724001 None] Lock "cinder-quobyte-e55fc1e5-74a5-4c17-8c78-4211bf53d0fe" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:54:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-07b1054c-8aa2-4739-9c65-07ddde36ff42 tempest-VolumesExtendTest-460724001 None] Deleting offline snapshot e55fc1e5-74a5-4c17-8c78-4211bf53d0fe of volume da330219-08b3-4498-8361-b6eda8d3d1e1 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 09:54:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-07b1054c-8aa2-4739-9c65-07ddde36ff42 tempest-VolumesExtendTest-460724001 None] snapshot_file for this snap is: volume-da330219-08b3-4498-8361-b6eda8d3d1e1.e55fc1e5-74a5-4c17-8c78-4211bf53d0fe {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 09:54:16 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[977ae38a-5295-4c8f-b5d2-9e2f45d10e8c]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:54:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-07b1054c-8aa2-4739-9c65-07ddde36ff42 tempest-VolumesExtendTest-460724001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1.e55fc1e5-74a5-4c17-8c78-4211bf53d0fe {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:16 devstack sudo[102199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1.e55fc1e5-74a5-4c17-8c78-4211bf53d0fe
Nov 05 09:54:16 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:54:17 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root
Nov 05 09:54:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-07b1054c-8aa2-4739-9c65-07ddde36ff42 tempest-VolumesExtendTest-460724001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1.e55fc1e5-74a5-4c17-8c78-4211bf53d0fe" returned: 0 in 0.350s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-07b1054c-8aa2-4739-9c65-07ddde36ff42 tempest-VolumesExtendTest-460724001 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da330219-08b3-4498-8361-b6eda8d3d1e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 09:54:17 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8a85e8-49d3-4200-ad52-d6c752b23cb2]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:54:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-07b1054c-8aa2-4739-9c65-07ddde36ff42 tempest-VolumesExtendTest-460724001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:17 devstack sudo[102204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1
Nov 05 09:54:17 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:54:17 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root
Nov 05 09:54:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-07b1054c-8aa2-4739-9c65-07ddde36ff42 tempest-VolumesExtendTest-460724001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1" returned: 0 in 0.341s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-07b1054c-8aa2-4739-9c65-07ddde36ff42 tempest-VolumesExtendTest-460724001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1.e55fc1e5-74a5-4c17-8c78-4211bf53d0fe {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:17 devstack sudo[102209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1.e55fc1e5-74a5-4c17-8c78-4211bf53d0fe
Nov 05 09:54:17 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:54:17 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root
Nov 05 09:54:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-07b1054c-8aa2-4739-9c65-07ddde36ff42 tempest-VolumesExtendTest-460724001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1.e55fc1e5-74a5-4c17-8c78-4211bf53d0fe" returned: 0 in 0.367s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-07b1054c-8aa2-4739-9c65-07ddde36ff42 tempest-VolumesExtendTest-460724001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1.e55fc1e5-74a5-4c17-8c78-4211bf53d0fe {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:17 devstack sudo[102215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1.e55fc1e5-74a5-4c17-8c78-4211bf53d0fe
Nov 05 09:54:17 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:54:18 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root
Nov 05 09:54:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-07b1054c-8aa2-4739-9c65-07ddde36ff42 tempest-VolumesExtendTest-460724001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1.e55fc1e5-74a5-4c17-8c78-4211bf53d0fe" returned: 0 in 0.248s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-07b1054c-8aa2-4739-9c65-07ddde36ff42 tempest-VolumesExtendTest-460724001 None] Lock "cinder-quobyte-e55fc1e5-74a5-4c17-8c78-4211bf53d0fe" released by "_delete_snapshot" :: held 1.410s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:54:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-07b1054c-8aa2-4739-9c65-07ddde36ff42 tempest-VolumesExtendTest-460724001 None] Lock "cinder-quobyte-da330219-08b3-4498-8361-b6eda8d3d1e1" released by "delete_snapshot" :: held 1.432s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:54:18 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-07b1054c-8aa2-4739-9c65-07ddde36ff42 tempest-VolumesExtendTest-460724001 None] Created reservations ['c597d383-e1bf-4f06-933a-48816d9c2421', '2e271b8e-d245-47d2-8a78-e6dc817cdefd', 'f617fcf5-abe6-4356-bfe3-b3c593d78db6', 'eb393121-f06b-4ae4-ab7f-a1bd9fa7dfaf'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:54:18 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-07b1054c-8aa2-4739-9c65-07ddde36ff42 tempest-VolumesExtendTest-460724001 None] Delete snapshot completed successfully.
Nov 05 09:54:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-07b1054c-8aa2-4739-9c65-07ddde36ff42 tempest-VolumesExtendTest-460724001 None] Lock "cinder-e55fc1e5-74a5-4c17-8c78-4211bf53d0fe-delete_snapshot" released by "delete_snapshot" :: held 1.575s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:54:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-10b6327a-9689-4398-835b-a3f1d02eebbb tempest-VolumesExtendTest-460724001 None] Acquiring lock "cinder-da330219-08b3-4498-8361-b6eda8d3d1e1-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:54:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-10b6327a-9689-4398-835b-a3f1d02eebbb tempest-VolumesExtendTest-460724001 None] Lock "cinder-da330219-08b3-4498-8361-b6eda8d3d1e1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:54:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-10b6327a-9689-4398-835b-a3f1d02eebbb tempest-VolumesExtendTest-460724001 None] Acquiring lock "cinder-quobyte-da330219-08b3-4498-8361-b6eda8d3d1e1" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:54:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-10b6327a-9689-4398-835b-a3f1d02eebbb tempest-VolumesExtendTest-460724001 None] Lock "cinder-quobyte-da330219-08b3-4498-8361-b6eda8d3d1e1" acquired by "delete_volume" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:54:19 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8796482-bec0-4e2f-ae78-998f31f3a83f]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:54:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-10b6327a-9689-4398-835b-a3f1d02eebbb tempest-VolumesExtendTest-460724001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:19 devstack sudo[102218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1
Nov 05 09:54:19 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:54:19 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root
Nov 05 09:54:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-10b6327a-9689-4398-835b-a3f1d02eebbb tempest-VolumesExtendTest-460724001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1" returned: 0 in 0.366s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-10b6327a-9689-4398-835b-a3f1d02eebbb tempest-VolumesExtendTest-460724001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:19 devstack sudo[102223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1
Nov 05 09:54:19 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:54:19 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root
Nov 05 09:54:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-10b6327a-9689-4398-835b-a3f1d02eebbb tempest-VolumesExtendTest-460724001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-da330219-08b3-4498-8361-b6eda8d3d1e1" returned: 0 in 0.244s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-10b6327a-9689-4398-835b-a3f1d02eebbb tempest-VolumesExtendTest-460724001 None] Lock "cinder-quobyte-da330219-08b3-4498-8361-b6eda8d3d1e1" released by "delete_volume" :: held 0.670s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:54:19 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-10b6327a-9689-4398-835b-a3f1d02eebbb tempest-VolumesExtendTest-460724001 None] Created reservations ['027ed784-db26-456f-968c-fec546006766', '4627f614-268c-4cc2-8e1c-159441e07f08', '17838d70-903a-4457-8092-33cee1baba3f', '00392d6c-7c3e-403f-9e46-0288c7b1e790'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:54:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-10b6327a-9689-4398-835b-a3f1d02eebbb tempest-VolumesExtendTest-460724001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:54:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-10b6327a-9689-4398-835b-a3f1d02eebbb tempest-VolumesExtendTest-460724001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:54:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-10b6327a-9689-4398-835b-a3f1d02eebbb tempest-VolumesExtendTest-460724001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:54:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-10b6327a-9689-4398-835b-a3f1d02eebbb tempest-VolumesExtendTest-460724001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:54:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-10b6327a-9689-4398-835b-a3f1d02eebbb tempest-VolumesExtendTest-460724001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:54:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-10b6327a-9689-4398-835b-a3f1d02eebbb tempest-VolumesExtendTest-460724001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:19 devstack sudo[102227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:54:19 devstack sudo[102227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:54:20 devstack sudo[102227]: pam_unix(sudo:session): session closed for user root
Nov 05 09:54:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-10b6327a-9689-4398-835b-a3f1d02eebbb tempest-VolumesExtendTest-460724001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.265s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:20 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-10b6327a-9689-4398-835b-a3f1d02eebbb tempest-VolumesExtendTest-460724001 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:54:20 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-10b6327a-9689-4398-835b-a3f1d02eebbb tempest-VolumesExtendTest-460724001 None] Deleted volume successfully.
Nov 05 09:54:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-10b6327a-9689-4398-835b-a3f1d02eebbb tempest-VolumesExtendTest-460724001 None] Lock "cinder-da330219-08b3-4498-8361-b6eda8d3d1e1-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:54:29 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=45,cinder:UPDATE=46,cinder:INSERT=13,cinder:DELETE=2 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:54:30 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=43,cinder:SELECT=37,cinder:INSERT=19,cinder:DELETE=4 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:54:42 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:54:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] Flow 'volume_create_manager' (35e9b0ac-fd60-46b8-a6ec-a5139593777b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:54:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (218e2179-9794-49c9-8066-87130501ffab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:54:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (218e2179-9794-49c9-8066-87130501ffab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-742851218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f77bea09-1b36-4e57-8ec9-cb9045a1a181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769b21c991a542fb89fece85bdaf3634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:54:43Z,use_quota=True,user_id='beb66f5331594baaa6d5413bd70a6f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:54:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10de7add-9288-487e-98bc-1d5300499f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:54:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10de7add-9288-487e-98bc-1d5300499f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:54:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca0f9c03-e6fb-4d3a-8284-7767cde32f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:54:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca0f9c03-e6fb-4d3a-8284-7767cde32f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f77bea09-1b36-4e57-8ec9-cb9045a1a181', 'volume_name': 'volume-f77bea09-1b36-4e57-8ec9-cb9045a1a181', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:54:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e22451a9-c4d3-4bd9-adbc-1b57e1adecc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:54:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e22451a9-c4d3-4bd9-adbc-1b57e1adecc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:54:42 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af0e2e9e-a927-44ae-96da-6be53cd2c751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:54:42 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] Volume f77bea09-1b36-4e57-8ec9-cb9045a1a181: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f77bea09-1b36-4e57-8ec9-cb9045a1a181', 'volume_size': 1}
Nov 05 09:54:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:54:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:54:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-742851218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f77bea09-1b36-4e57-8ec9-cb9045a1a181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769b21c991a542fb89fece85bdaf3634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:54:43Z,use_quota=True,user_id='beb66f5331594baaa6d5413bd70a6f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:54:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] Creating volume f77bea09-1b36-4e57-8ec9-cb9045a1a181 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:54:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:54:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:54:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:54:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:54:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:54:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:54:42 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:54:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f77bea09-1b36-4e57-8ec9-cb9045a1a181 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:42 devstack sudo[102243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f77bea09-1b36-4e57-8ec9-cb9045a1a181 1073741824
Nov 05 09:54:42 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:54:43 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 09:54:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Flow 'volume_create_manager' (f78c4d0e-6701-4f1e-9dbf-b021e5562cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:54:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b75ee33-d54a-4411-a73c-16378f3bbb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:54:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b75ee33-d54a-4411-a73c-16378f3bbb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1203927018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c124be6b-13a9-4ee4-9222-ecd23b856719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769b21c991a542fb89fece85bdaf3634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:54:43Z,use_quota=True,user_id='beb66f5331594baaa6d5413bd70a6f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:54:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124459b0-3b0f-4edf-80da-ad7057296085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:54:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124459b0-3b0f-4edf-80da-ad7057296085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:54:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2accf78b-704a-4592-902b-a9c7904b3665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:54:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2accf78b-704a-4592-902b-a9c7904b3665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c124be6b-13a9-4ee4-9222-ecd23b856719', 'volume_name': 'volume-c124be6b-13a9-4ee4-9222-ecd23b856719', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:54:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3d3a83b-7509-404a-957e-0e7f9ccb846d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:54:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3d3a83b-7509-404a-957e-0e7f9ccb846d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:54:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3921ef4f-0b73-44a6-9239-b2bbe4af2eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:54:43 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Volume c124be6b-13a9-4ee4-9222-ecd23b856719: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c124be6b-13a9-4ee4-9222-ecd23b856719', 'volume_size': 1}
Nov 05 09:54:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:54:43 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root
Nov 05 09:54:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f77bea09-1b36-4e57-8ec9-cb9045a1a181 1073741824" returned: 0 in 0.530s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f77bea09-1b36-4e57-8ec9-cb9045a1a181 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:43 devstack sudo[102249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f77bea09-1b36-4e57-8ec9-cb9045a1a181
Nov 05 09:54:43 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:54:43 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root
Nov 05 09:54:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f77bea09-1b36-4e57-8ec9-cb9045a1a181" returned: 0 in 0.294s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:54:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:54:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.499s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:54:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T08:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1203927018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c124be6b-13a9-4ee4-9222-ecd23b856719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769b21c991a542fb89fece85bdaf3634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T08:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T08:54:43Z,use_quota=True,user_id='beb66f5331594baaa6d5413bd70a6f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 09:54:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Creating volume c124be6b-13a9-4ee4-9222-ecd23b856719 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 09:54:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:54:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:54:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:54:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:54:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:54:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 09:54:43 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 09:54:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c124be6b-13a9-4ee4-9222-ecd23b856719 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:43 devstack sudo[102252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c124be6b-13a9-4ee4-9222-ecd23b856719 1073741824
Nov 05 09:54:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af0e2e9e-a927-44ae-96da-6be53cd2c751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f77bea09-1b36-4e57-8ec9-cb9045a1a181', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:54:43 devstack sudo[102252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:54:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdbd0518-30d5-4ba0-9aaa-d4230ae38295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:54:43 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] Volume volume-f77bea09-1b36-4e57-8ec9-cb9045a1a181 (f77bea09-1b36-4e57-8ec9-cb9045a1a181): created successfully
Nov 05 09:54:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdbd0518-30d5-4ba0-9aaa-d4230ae38295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:54:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] Flow 'volume_create_manager' (35e9b0ac-fd60-46b8-a6ec-a5139593777b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:54:43 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-7162a8f2-6c3e-4793-9cca-942b7b2d741a tempest-TestServerVolumeAttachmentScenario-1334397228 None] Created volume successfully.
Nov 05 09:54:44 devstack sudo[102252]: pam_unix(sudo:session): session closed for user root
Nov 05 09:54:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c124be6b-13a9-4ee4-9222-ecd23b856719 1073741824" returned: 0 in 0.534s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c124be6b-13a9-4ee4-9222-ecd23b856719 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:54:44 devstack sudo[102295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c124be6b-13a9-4ee4-9222-ecd23b856719
Nov 05 09:54:44 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:54:44 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root
Nov 05 09:54:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c124be6b-13a9-4ee4-9222-ecd23b856719" returned: 0 in 0.273s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:54:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 09:54:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:54:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3921ef4f-0b73-44a6-9239-b2bbe4af2eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c124be6b-13a9-4ee4-9222-ecd23b856719', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:54:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca480b4-984e-4447-abfa-2b7f1cafa95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 09:54:44 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Volume volume-c124be6b-13a9-4ee4-9222-ecd23b856719 (c124be6b-13a9-4ee4-9222-ecd23b856719): created successfully
Nov 05 09:54:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca480b4-984e-4447-abfa-2b7f1cafa95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 09:54:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Flow 'volume_create_manager' (f78c4d0e-6701-4f1e-9dbf-b021e5562cf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 09:54:44 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-7fa80f84-1606-4ac5-8262-fa588188ace3 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Created volume successfully.
Nov 05 09:54:54 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:54:54 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=2,cinder:UPDATE=5,cinder:DELETE=2,cinder:INSERT=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:55:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:55:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:55:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:55:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:55:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:55:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:55:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:55:00 devstack sudo[102384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:55:00 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:55:00 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root
Nov 05 09:55:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.265s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:55:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:55:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:55:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 28 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:55:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>, <Thread(tpool_thread_0, started daemon 132223357408960)>, <Thread(tpool_thread_1, started daemon 132223349016256)>, <Thread(tpool_thread_2, started daemon 132223340623552)>, <Thread(tpool_thread_3, started daemon 132223332230848)>, <Thread(tpool_thread_4, started daemon 132223323838144)>, <Thread(tpool_thread_5, started daemon 132223315445440)>, <Thread(tpool_thread_6, started daemon 132223307052736)>, <Thread(tpool_thread_7, started daemon 132223298660032)>, <Thread(tpool_thread_8, started daemon 132223290250944)>, <Thread(tpool_thread_9, started daemon 132223281841856)>, <Thread(tpool_thread_10, started daemon 132223273432768)>, <Thread(tpool_thread_11, started daemon 132223265023680)>, <Thread(tpool_thread_12, started daemon 132223256614592)>, <Thread(tpool_thread_13, started daemon 132223248205504)>, <Thread(tpool_thread_14, started daemon 132223239796416)>, <Thread(tpool_thread_15, started daemon 132223231387328)>, <Thread(tpool_thread_16, started daemon 132223222978240)>, <Thread(tpool_thread_17, started daemon 132223214569152)>, <Thread(tpool_thread_18, started daemon 132223206160064)>, <Thread(tpool_thread_19, started daemon 132223197750976)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:55:06 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:56:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:56:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:56:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:56:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:56:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:56:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:56:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:56:00 devstack sudo[102866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:56:00 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:56:00 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root
Nov 05 09:56:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.271s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:56:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:56:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:56:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 28 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:56:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>, <Thread(tpool_thread_0, started daemon 132223357408960)>, <Thread(tpool_thread_1, started daemon 132223349016256)>, <Thread(tpool_thread_2, started daemon 132223340623552)>, <Thread(tpool_thread_3, started daemon 132223332230848)>, <Thread(tpool_thread_4, started daemon 132223323838144)>, <Thread(tpool_thread_5, started daemon 132223315445440)>, <Thread(tpool_thread_6, started daemon 132223307052736)>, <Thread(tpool_thread_7, started daemon 132223298660032)>, <Thread(tpool_thread_8, started daemon 132223290250944)>, <Thread(tpool_thread_9, started daemon 132223281841856)>, <Thread(tpool_thread_10, started daemon 132223273432768)>, <Thread(tpool_thread_11, started daemon 132223265023680)>, <Thread(tpool_thread_12, started daemon 132223256614592)>, <Thread(tpool_thread_13, started daemon 132223248205504)>, <Thread(tpool_thread_14, started daemon 132223239796416)>, <Thread(tpool_thread_15, started daemon 132223231387328)>, <Thread(tpool_thread_16, started daemon 132223222978240)>, <Thread(tpool_thread_17, started daemon 132223214569152)>, <Thread(tpool_thread_18, started daemon 132223206160064)>, <Thread(tpool_thread_19, started daemon 132223197750976)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:57:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:57:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:57:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:57:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:57:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:57:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:57:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:57:00 devstack sudo[102928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:57:00 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:57:00 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root
Nov 05 09:57:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.262s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:57:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:57:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:57:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 28 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:57:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>, <Thread(tpool_thread_0, started daemon 132223357408960)>, <Thread(tpool_thread_1, started daemon 132223349016256)>, <Thread(tpool_thread_2, started daemon 132223340623552)>, <Thread(tpool_thread_3, started daemon 132223332230848)>, <Thread(tpool_thread_4, started daemon 132223323838144)>, <Thread(tpool_thread_5, started daemon 132223315445440)>, <Thread(tpool_thread_6, started daemon 132223307052736)>, <Thread(tpool_thread_7, started daemon 132223298660032)>, <Thread(tpool_thread_8, started daemon 132223290250944)>, <Thread(tpool_thread_9, started daemon 132223281841856)>, <Thread(tpool_thread_10, started daemon 132223273432768)>, <Thread(tpool_thread_11, started daemon 132223265023680)>, <Thread(tpool_thread_12, started daemon 132223256614592)>, <Thread(tpool_thread_13, started daemon 132223248205504)>, <Thread(tpool_thread_14, started daemon 132223239796416)>, <Thread(tpool_thread_15, started daemon 132223231387328)>, <Thread(tpool_thread_16, started daemon 132223222978240)>, <Thread(tpool_thread_17, started daemon 132223214569152)>, <Thread(tpool_thread_18, started daemon 132223206160064)>, <Thread(tpool_thread_19, started daemon 132223197750976)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:57:06 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:57:06 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:58:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:58:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:58:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:58:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:58:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:58:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:58:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:58:00 devstack sudo[102991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:58:00 devstack sudo[102991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:58:00 devstack sudo[102991]: pam_unix(sudo:session): session closed for user root
Nov 05 09:58:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.265s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:58:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:58:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:58:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 28 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:58:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>, <Thread(tpool_thread_0, started daemon 132223357408960)>, <Thread(tpool_thread_1, started daemon 132223349016256)>, <Thread(tpool_thread_2, started daemon 132223340623552)>, <Thread(tpool_thread_3, started daemon 132223332230848)>, <Thread(tpool_thread_4, started daemon 132223323838144)>, <Thread(tpool_thread_5, started daemon 132223315445440)>, <Thread(tpool_thread_6, started daemon 132223307052736)>, <Thread(tpool_thread_7, started daemon 132223298660032)>, <Thread(tpool_thread_8, started daemon 132223290250944)>, <Thread(tpool_thread_9, started daemon 132223281841856)>, <Thread(tpool_thread_10, started daemon 132223273432768)>, <Thread(tpool_thread_11, started daemon 132223265023680)>, <Thread(tpool_thread_12, started daemon 132223256614592)>, <Thread(tpool_thread_13, started daemon 132223248205504)>, <Thread(tpool_thread_14, started daemon 132223239796416)>, <Thread(tpool_thread_15, started daemon 132223231387328)>, <Thread(tpool_thread_16, started daemon 132223222978240)>, <Thread(tpool_thread_17, started daemon 132223214569152)>, <Thread(tpool_thread_18, started daemon 132223206160064)>, <Thread(tpool_thread_19, started daemon 132223197750976)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:59:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:59:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:59:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:59:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:59:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:59:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:59:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:59:00 devstack sudo[103052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:59:00 devstack sudo[103052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:59:00 devstack sudo[103052]: pam_unix(sudo:session): session closed for user root
Nov 05 09:59:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.262s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:59:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:59:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 09:59:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 28 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 09:59:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>, <Thread(tpool_thread_0, started daemon 132223357408960)>, <Thread(tpool_thread_1, started daemon 132223349016256)>, <Thread(tpool_thread_2, started daemon 132223340623552)>, <Thread(tpool_thread_3, started daemon 132223332230848)>, <Thread(tpool_thread_4, started daemon 132223323838144)>, <Thread(tpool_thread_5, started daemon 132223315445440)>, <Thread(tpool_thread_6, started daemon 132223307052736)>, <Thread(tpool_thread_7, started daemon 132223298660032)>, <Thread(tpool_thread_8, started daemon 132223290250944)>, <Thread(tpool_thread_9, started daemon 132223281841856)>, <Thread(tpool_thread_10, started daemon 132223273432768)>, <Thread(tpool_thread_11, started daemon 132223265023680)>, <Thread(tpool_thread_12, started daemon 132223256614592)>, <Thread(tpool_thread_13, started daemon 132223248205504)>, <Thread(tpool_thread_14, started daemon 132223239796416)>, <Thread(tpool_thread_15, started daemon 132223231387328)>, <Thread(tpool_thread_16, started daemon 132223222978240)>, <Thread(tpool_thread_17, started daemon 132223214569152)>, <Thread(tpool_thread_18, started daemon 132223206160064)>, <Thread(tpool_thread_19, started daemon 132223197750976)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 09:59:06 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:59:06 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=1 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 09:59:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b069ba3d-bc15-4748-bdc1-86dd6820551f tempest-TestServerVolumeAttachmentScenario-1334397228 None] Acquiring lock "cinder-c124be6b-13a9-4ee4-9222-ecd23b856719-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:59:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b069ba3d-bc15-4748-bdc1-86dd6820551f tempest-TestServerVolumeAttachmentScenario-1334397228 None] Lock "cinder-c124be6b-13a9-4ee4-9222-ecd23b856719-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:59:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b069ba3d-bc15-4748-bdc1-86dd6820551f tempest-TestServerVolumeAttachmentScenario-1334397228 None] Acquiring lock "cinder-quobyte-c124be6b-13a9-4ee4-9222-ecd23b856719" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:59:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b069ba3d-bc15-4748-bdc1-86dd6820551f tempest-TestServerVolumeAttachmentScenario-1334397228 None] Lock "cinder-quobyte-c124be6b-13a9-4ee4-9222-ecd23b856719" acquired by "delete_volume" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:59:54 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[472f30fe-76fa-464c-a7a9-9a03eda61437]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:59:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b069ba3d-bc15-4748-bdc1-86dd6820551f tempest-TestServerVolumeAttachmentScenario-1334397228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c124be6b-13a9-4ee4-9222-ecd23b856719 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:59:54 devstack sudo[103140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c124be6b-13a9-4ee4-9222-ecd23b856719
Nov 05 09:59:54 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:59:54 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root
Nov 05 09:59:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b069ba3d-bc15-4748-bdc1-86dd6820551f tempest-TestServerVolumeAttachmentScenario-1334397228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c124be6b-13a9-4ee4-9222-ecd23b856719" returned: 0 in 0.377s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:59:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b069ba3d-bc15-4748-bdc1-86dd6820551f tempest-TestServerVolumeAttachmentScenario-1334397228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c124be6b-13a9-4ee4-9222-ecd23b856719 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:59:54 devstack sudo[103145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c124be6b-13a9-4ee4-9222-ecd23b856719
Nov 05 09:59:54 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:59:54 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root
Nov 05 09:59:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b069ba3d-bc15-4748-bdc1-86dd6820551f tempest-TestServerVolumeAttachmentScenario-1334397228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c124be6b-13a9-4ee4-9222-ecd23b856719" returned: 0 in 0.262s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:59:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b069ba3d-bc15-4748-bdc1-86dd6820551f tempest-TestServerVolumeAttachmentScenario-1334397228 None] Lock "cinder-quobyte-c124be6b-13a9-4ee4-9222-ecd23b856719" released by "delete_volume" :: held 0.693s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:59:54 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-b069ba3d-bc15-4748-bdc1-86dd6820551f tempest-TestServerVolumeAttachmentScenario-1334397228 None] Created reservations ['fdc26548-6796-4b8e-b8b2-f6c63a8910d6', '62222f0f-45f7-4727-aee1-b57d2595ae3c', '587c9bcf-5fc5-4dac-96ab-fa960676dc3a', 'ead10583-ae58-48ff-9ca8-b26879103aad'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:59:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b069ba3d-bc15-4748-bdc1-86dd6820551f tempest-TestServerVolumeAttachmentScenario-1334397228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:59:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b069ba3d-bc15-4748-bdc1-86dd6820551f tempest-TestServerVolumeAttachmentScenario-1334397228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:59:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b069ba3d-bc15-4748-bdc1-86dd6820551f tempest-TestServerVolumeAttachmentScenario-1334397228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:59:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b069ba3d-bc15-4748-bdc1-86dd6820551f tempest-TestServerVolumeAttachmentScenario-1334397228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:59:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b069ba3d-bc15-4748-bdc1-86dd6820551f tempest-TestServerVolumeAttachmentScenario-1334397228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:59:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b069ba3d-bc15-4748-bdc1-86dd6820551f tempest-TestServerVolumeAttachmentScenario-1334397228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:59:54 devstack sudo[103148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:59:54 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:59:55 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root
Nov 05 09:59:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7f695321-3652-4ef8-a89d-e0775a202124 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Acquiring lock "cinder-f77bea09-1b36-4e57-8ec9-cb9045a1a181-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:59:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b069ba3d-bc15-4748-bdc1-86dd6820551f tempest-TestServerVolumeAttachmentScenario-1334397228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.277s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:59:55 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-b069ba3d-bc15-4748-bdc1-86dd6820551f tempest-TestServerVolumeAttachmentScenario-1334397228 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:59:55 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b069ba3d-bc15-4748-bdc1-86dd6820551f tempest-TestServerVolumeAttachmentScenario-1334397228 None] Deleted volume successfully.
Nov 05 09:59:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7f695321-3652-4ef8-a89d-e0775a202124 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Lock "cinder-f77bea09-1b36-4e57-8ec9-cb9045a1a181-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:59:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b069ba3d-bc15-4748-bdc1-86dd6820551f tempest-TestServerVolumeAttachmentScenario-1334397228 None] Lock "cinder-c124be6b-13a9-4ee4-9222-ecd23b856719-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:59:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7f695321-3652-4ef8-a89d-e0775a202124 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Acquiring lock "cinder-quobyte-f77bea09-1b36-4e57-8ec9-cb9045a1a181" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 09:59:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7f695321-3652-4ef8-a89d-e0775a202124 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Lock "cinder-quobyte-f77bea09-1b36-4e57-8ec9-cb9045a1a181" acquired by "delete_volume" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 09:59:55 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef033ca-e283-4e23-8137-531c26fe5bbc]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 09:59:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7f695321-3652-4ef8-a89d-e0775a202124 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f77bea09-1b36-4e57-8ec9-cb9045a1a181 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:59:55 devstack sudo[103151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f77bea09-1b36-4e57-8ec9-cb9045a1a181
Nov 05 09:59:55 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:59:55 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root
Nov 05 09:59:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7f695321-3652-4ef8-a89d-e0775a202124 tempest-TestServerVolumeAttachmentScenario-1334397228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f77bea09-1b36-4e57-8ec9-cb9045a1a181" returned: 0 in 0.369s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:59:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7f695321-3652-4ef8-a89d-e0775a202124 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f77bea09-1b36-4e57-8ec9-cb9045a1a181 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:59:55 devstack sudo[103156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f77bea09-1b36-4e57-8ec9-cb9045a1a181
Nov 05 09:59:55 devstack sudo[103156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:59:55 devstack sudo[103156]: pam_unix(sudo:session): session closed for user root
Nov 05 09:59:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7f695321-3652-4ef8-a89d-e0775a202124 tempest-TestServerVolumeAttachmentScenario-1334397228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f77bea09-1b36-4e57-8ec9-cb9045a1a181" returned: 0 in 0.249s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:59:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7f695321-3652-4ef8-a89d-e0775a202124 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Lock "cinder-quobyte-f77bea09-1b36-4e57-8ec9-cb9045a1a181" released by "delete_volume" :: held 0.667s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 09:59:56 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-7f695321-3652-4ef8-a89d-e0775a202124 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Created reservations ['c139baf4-f9c3-4e9b-8209-bd6063c5eee5', '3ae30e2f-40e6-4cba-a3f7-0afb6ac73fac', 'db9f0142-35e4-4bd8-9e61-914a8f80a8ff', 'bac6ab75-d7b1-4e70-931c-524a698ec865'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 09:59:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7f695321-3652-4ef8-a89d-e0775a202124 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 09:59:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7f695321-3652-4ef8-a89d-e0775a202124 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 09:59:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7f695321-3652-4ef8-a89d-e0775a202124 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 09:59:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7f695321-3652-4ef8-a89d-e0775a202124 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 09:59:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7f695321-3652-4ef8-a89d-e0775a202124 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 09:59:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7f695321-3652-4ef8-a89d-e0775a202124 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 09:59:56 devstack sudo[103159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 09:59:56 devstack sudo[103159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 09:59:56 devstack sudo[103159]: pam_unix(sudo:session): session closed for user root
Nov 05 09:59:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7f695321-3652-4ef8-a89d-e0775a202124 tempest-TestServerVolumeAttachmentScenario-1334397228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.250s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 09:59:56 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-7f695321-3652-4ef8-a89d-e0775a202124 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 09:59:56 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-7f695321-3652-4ef8-a89d-e0775a202124 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Deleted volume successfully.
Nov 05 09:59:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7f695321-3652-4ef8-a89d-e0775a202124 tempest-TestServerVolumeAttachmentScenario-1334397228 None] Lock "cinder-f77bea09-1b36-4e57-8ec9-cb9045a1a181-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:00:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 10:00:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:00:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:00:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:00:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:00:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:00:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:00 devstack sudo[103166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:00:00 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:00 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.281s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:00:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 10:00:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 28 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 10:00:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>, <Thread(tpool_thread_0, started daemon 132223357408960)>, <Thread(tpool_thread_1, started daemon 132223349016256)>, <Thread(tpool_thread_2, started daemon 132223340623552)>, <Thread(tpool_thread_3, started daemon 132223332230848)>, <Thread(tpool_thread_4, started daemon 132223323838144)>, <Thread(tpool_thread_5, started daemon 132223315445440)>, <Thread(tpool_thread_6, started daemon 132223307052736)>, <Thread(tpool_thread_7, started daemon 132223298660032)>, <Thread(tpool_thread_8, started daemon 132223290250944)>, <Thread(tpool_thread_9, started daemon 132223281841856)>, <Thread(tpool_thread_10, started daemon 132223273432768)>, <Thread(tpool_thread_11, started daemon 132223265023680)>, <Thread(tpool_thread_12, started daemon 132223256614592)>, <Thread(tpool_thread_13, started daemon 132223248205504)>, <Thread(tpool_thread_14, started daemon 132223239796416)>, <Thread(tpool_thread_15, started daemon 132223231387328)>, <Thread(tpool_thread_16, started daemon 132223222978240)>, <Thread(tpool_thread_17, started daemon 132223214569152)>, <Thread(tpool_thread_18, started daemon 132223206160064)>, <Thread(tpool_thread_19, started daemon 132223197750976)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 10:00:06 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=9,cinder:INSERT=4,cinder:UPDATE=17 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 10:00:06 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=11,cinder:UPDATE=15,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 10:00:08 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:00:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Flow 'volume_create_manager' (37927c4f-ac4e-4080-93f8-d07d668b3311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:00:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af72134f-bded-44d3-92ad-7f48593eb106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af72134f-bded-44d3-92ad-7f48593eb106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2069602118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e07415f-6282-4102-b635-5183c998609b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4327874dbad046f1816cf4fb0150d77a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:00:08Z,use_quota=True,user_id='2c711b56e1af4a958c894e78ee7ed164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be2ff51-5c0c-4ca4-a286-0d017a089fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be2ff51-5c0c-4ca4-a286-0d017a089fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c65f097b-b3f5-47a9-b1d2-d54ee3fb984c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c65f097b-b3f5-47a9-b1d2-d54ee3fb984c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e07415f-6282-4102-b635-5183c998609b', 'volume_name': 'volume-6e07415f-6282-4102-b635-5183c998609b', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e778377d-bd7e-4c20-9b78-424aa634d756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e778377d-bd7e-4c20-9b78-424aa634d756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39126b45-0861-47b9-961c-855b3cf1592a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:08 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Volume 6e07415f-6282-4102-b635-5183c998609b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e07415f-6282-4102-b635-5183c998609b', 'volume_size': 1}
Nov 05 10:00:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:00:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:00:08 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2069602118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e07415f-6282-4102-b635-5183c998609b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4327874dbad046f1816cf4fb0150d77a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:00:08Z,use_quota=True,user_id='2c711b56e1af4a958c894e78ee7ed164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:00:08 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Creating volume 6e07415f-6282-4102-b635-5183c998609b {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:00:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:00:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:00:08 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:00:08 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:00:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:00:08 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:00:08 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:00:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:08 devstack sudo[103175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b 1073741824
Nov 05 10:00:08 devstack sudo[103175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:08 devstack sudo[103175]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b 1073741824" returned: 0 in 0.417s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:08 devstack sudo[103180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b
Nov 05 10:00:08 devstack sudo[103180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:09 devstack sudo[103180]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b" returned: 0 in 0.251s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:00:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:00:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39126b45-0861-47b9-961c-855b3cf1592a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e07415f-6282-4102-b635-5183c998609b', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e4cc426-3a16-478b-a338-a67aa942fcf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:09 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Volume volume-6e07415f-6282-4102-b635-5183c998609b (6e07415f-6282-4102-b635-5183c998609b): created successfully
Nov 05 10:00:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e4cc426-3a16-478b-a338-a67aa942fcf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:09 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Flow 'volume_create_manager' (37927c4f-ac4e-4080-93f8-d07d668b3311) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:00:09 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c53a76df-952b-48bf-aff6-52daeabf2e13 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Created volume successfully.
Nov 05 10:00:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-42e84d96-35ac-4aca-9ad6-6ff4de68e7d3 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:00:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-42e84d96-35ac-4aca-9ad6-6ff4de68e7d3 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:00:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-42e84d96-35ac-4aca-9ad6-6ff4de68e7d3 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Creating offline snapshot 527df2b5-1045-4ee6-a340-979234ffedf0 of volume 6e07415f-6282-4102-b635-5183c998609b {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 10:00:09 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec828fb2-908b-4cd9-b855-38dc1dc6e9c9]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:00:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-42e84d96-35ac-4aca-9ad6-6ff4de68e7d3 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:09 devstack sudo[103183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b
Nov 05 10:00:09 devstack sudo[103183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:09 devstack sudo[103183]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-42e84d96-35ac-4aca-9ad6-6ff4de68e7d3 tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b" returned: 0 in 0.369s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-42e84d96-35ac-4aca-9ad6-6ff4de68e7d3 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b.527df2b5-1045-4ee6-a340-979234ffedf0 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:09 devstack sudo[103189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b.527df2b5-1045-4ee6-a340-979234ffedf0 1G
Nov 05 10:00:09 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:10 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-42e84d96-35ac-4aca-9ad6-6ff4de68e7d3 tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b.527df2b5-1045-4ee6-a340-979234ffedf0 1G" returned: 0 in 0.406s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-42e84d96-35ac-4aca-9ad6-6ff4de68e7d3 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e07415f-6282-4102-b635-5183c998609b -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b.527df2b5-1045-4ee6-a340-979234ffedf0 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:10 devstack sudo[103194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e07415f-6282-4102-b635-5183c998609b -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b.527df2b5-1045-4ee6-a340-979234ffedf0
Nov 05 10:00:10 devstack sudo[103194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:10 devstack sudo[103194]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-42e84d96-35ac-4aca-9ad6-6ff4de68e7d3 tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e07415f-6282-4102-b635-5183c998609b -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b.527df2b5-1045-4ee6-a340-979234ffedf0" returned: 0 in 0.300s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:10 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-42e84d96-35ac-4aca-9ad6-6ff4de68e7d3 tempest-CreateVolumesFromSnapshotTest-1116241530 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b.527df2b5-1045-4ee6-a340-979234ffedf0 is being set with open permissions: ugo+rw
Nov 05 10:00:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-42e84d96-35ac-4aca-9ad6-6ff4de68e7d3 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b.527df2b5-1045-4ee6-a340-979234ffedf0 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:10 devstack sudo[103200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b.527df2b5-1045-4ee6-a340-979234ffedf0
Nov 05 10:00:10 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:10 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-42e84d96-35ac-4aca-9ad6-6ff4de68e7d3 tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b.527df2b5-1045-4ee6-a340-979234ffedf0" returned: 0 in 0.242s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-42e84d96-35ac-4aca-9ad6-6ff4de68e7d3 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:10 devstack sudo[103203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b.info
Nov 05 10:00:10 devstack sudo[103203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:11 devstack sudo[103203]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-42e84d96-35ac-4aca-9ad6-6ff4de68e7d3 tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b.info" returned: 0 in 0.250s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:11 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-42e84d96-35ac-4aca-9ad6-6ff4de68e7d3 tempest-CreateVolumesFromSnapshotTest-1116241530 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b.info is being set with open permissions: ugo+rw
Nov 05 10:00:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-42e84d96-35ac-4aca-9ad6-6ff4de68e7d3 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:11 devstack sudo[103206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b.info
Nov 05 10:00:11 devstack sudo[103206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:11 devstack sudo[103206]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-42e84d96-35ac-4aca-9ad6-6ff4de68e7d3 tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b.info" returned: 0 in 0.241s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-42e84d96-35ac-4aca-9ad6-6ff4de68e7d3 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.900s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:00:11 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-42e84d96-35ac-4aca-9ad6-6ff4de68e7d3 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Create snapshot completed successfully
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] Flow 'volume_create_manager' (0e886e30-6e59-4836-945a-a39a24f9ff78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42aa6673-d2c5-4cff-a045-85aef54e2348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42aa6673-d2c5-4cff-a045-85aef54e2348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1232165047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=971a4211-dfb6-479d-9627-66441abc5edc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4327874dbad046f1816cf4fb0150d77a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:00:12Z,use_quota=True,user_id='2c711b56e1af4a958c894e78ee7ed164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dabca78-a124-45c0-b06c-884ade3e0b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dabca78-a124-45c0-b06c-884ade3e0b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (155866bc-4ee3-4fd0-bfb5-d6d16fa407fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (155866bc-4ee3-4fd0-bfb5-d6d16fa407fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '971a4211-dfb6-479d-9627-66441abc5edc', 'volume_name': 'volume-971a4211-dfb6-479d-9627-66441abc5edc', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0290bbc-d72f-4159-b4e1-4804ff44aac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0290bbc-d72f-4159-b4e1-4804ff44aac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a8707b-e151-456a-af5a-68453c1a0f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:12 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] Volume 971a4211-dfb6-479d-9627-66441abc5edc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-971a4211-dfb6-479d-9627-66441abc5edc', 'volume_size': 1}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1232165047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=971a4211-dfb6-479d-9627-66441abc5edc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4327874dbad046f1816cf4fb0150d77a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:00:12Z,use_quota=True,user_id='2c711b56e1af4a958c894e78ee7ed164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] Creating volume 971a4211-dfb6-479d-9627-66441abc5edc {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:00:12 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-971a4211-dfb6-479d-9627-66441abc5edc 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:12 devstack sudo[103209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-971a4211-dfb6-479d-9627-66441abc5edc 1073741824
Nov 05 10:00:12 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] Flow 'volume_create_manager' (2b6f4ab9-d2c6-4fb9-a53c-c49abbc5b635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13baaee8-9230-4aba-8f6f-b5fb2f1b843a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13baaee8-9230-4aba-8f6f-b5fb2f1b843a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1230058420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50e8eda5-0e06-427d-8578-2661cd78839e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4327874dbad046f1816cf4fb0150d77a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:00:12Z,use_quota=True,user_id='2c711b56e1af4a958c894e78ee7ed164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d798acb9-7198-4ddb-a641-98973fac20e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d798acb9-7198-4ddb-a641-98973fac20e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc6f078a-73a9-4c58-b937-e1b3d2d6d695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc6f078a-73a9-4c58-b937-e1b3d2d6d695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50e8eda5-0e06-427d-8578-2661cd78839e', 'volume_name': 'volume-50e8eda5-0e06-427d-8578-2661cd78839e', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b6b732f-716f-42d8-9ca9-c7f37590969f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b6b732f-716f-42d8-9ca9-c7f37590969f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7457c86b-3ba8-457c-aef3-6faff06317a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:12 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] Volume 50e8eda5-0e06-427d-8578-2661cd78839e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50e8eda5-0e06-427d-8578-2661cd78839e', 'volume_size': 1}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:00:12 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-971a4211-dfb6-479d-9627-66441abc5edc 1073741824" returned: 0 in 0.540s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-971a4211-dfb6-479d-9627-66441abc5edc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:12 devstack sudo[103215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-971a4211-dfb6-479d-9627-66441abc5edc
Nov 05 10:00:12 devstack sudo[103215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Flow 'volume_create_manager' (0aec4da1-d5e2-4cb7-af3b-a5c94b097b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb68218-6c7f-49dc-8006-edad57ffa7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb68218-6c7f-49dc-8006-edad57ffa7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-532648141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c6f8730-a792-46b3-9c48-7f18adbf64f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4327874dbad046f1816cf4fb0150d77a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:00:13Z,use_quota=True,user_id='2c711b56e1af4a958c894e78ee7ed164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39655416-f4e6-4b5a-8e4a-059fe8055d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39655416-f4e6-4b5a-8e4a-059fe8055d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbfdac43-89e2-4f5e-9828-964a721df7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbfdac43-89e2-4f5e-9828-964a721df7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c6f8730-a792-46b3-9c48-7f18adbf64f7', 'volume_name': 'volume-4c6f8730-a792-46b3-9c48-7f18adbf64f7', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4da1be43-46ba-458a-939e-4dd47ef7844d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4da1be43-46ba-458a-939e-4dd47ef7844d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f8d256-d9f0-4a31-913a-1bd59bccf48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:12 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Volume 4c6f8730-a792-46b3-9c48-7f18adbf64f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c6f8730-a792-46b3-9c48-7f18adbf64f7', 'volume_size': 1}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:00:12 devstack sudo[103215]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-971a4211-dfb6-479d-9627-66441abc5edc" returned: 0 in 0.294s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.497s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1230058420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50e8eda5-0e06-427d-8578-2661cd78839e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4327874dbad046f1816cf4fb0150d77a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:00:12Z,use_quota=True,user_id='2c711b56e1af4a958c894e78ee7ed164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] Creating volume 50e8eda5-0e06-427d-8578-2661cd78839e {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:00:12 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:00:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-50e8eda5-0e06-427d-8578-2661cd78839e 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a8707b-e151-456a-af5a-68453c1a0f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-971a4211-dfb6-479d-9627-66441abc5edc', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:13 devstack sudo[103218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-50e8eda5-0e06-427d-8578-2661cd78839e 1073741824
Nov 05 10:00:13 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0286b301-ad2d-45f7-a414-444866678783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:13 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] Volume volume-971a4211-dfb6-479d-9627-66441abc5edc (971a4211-dfb6-479d-9627-66441abc5edc): created successfully
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0286b301-ad2d-45f7-a414-444866678783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] Flow 'volume_create_manager' (0e886e30-6e59-4836-945a-a39a24f9ff78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:00:13 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-8ccbff5c-d602-4aba-8eb6-03d974fe645a tempest-CreateVolumesFromSnapshotTest-1116241530 None] Created volume successfully.
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Flow 'volume_create_manager' (43717a9b-78b5-48ee-bdfe-f8dca2bca1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a02c2ac-8a37-4ad8-a72e-45d9e9f82e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a02c2ac-8a37-4ad8-a72e-45d9e9f82e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1429227954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5486f0cc-e28e-4cae-93c1-d80899914ccc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4327874dbad046f1816cf4fb0150d77a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:00:13Z,use_quota=True,user_id='2c711b56e1af4a958c894e78ee7ed164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec50bb67-070e-47bb-a302-1ccbd1576453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec50bb67-070e-47bb-a302-1ccbd1576453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6821f91-2dcb-4dfa-a00d-0e139f4089ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6821f91-2dcb-4dfa-a00d-0e139f4089ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5486f0cc-e28e-4cae-93c1-d80899914ccc', 'volume_name': 'volume-5486f0cc-e28e-4cae-93c1-d80899914ccc', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ff18983-a601-4cb5-ab38-44bb1e934bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ff18983-a601-4cb5-ab38-44bb1e934bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7671c6a-d0e5-4cf6-951b-ac25c46145b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:13 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Volume 5486f0cc-e28e-4cae-93c1-d80899914ccc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5486f0cc-e28e-4cae-93c1-d80899914ccc', 'volume_size': 1}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:00:13 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-50e8eda5-0e06-427d-8578-2661cd78839e 1073741824" returned: 0 in 0.570s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Flow 'volume_create_manager' (602be856-d74b-408c-ab10-9cb784ec0dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2841566-f1c4-4ae9-85bf-666ccffcb135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-50e8eda5-0e06-427d-8578-2661cd78839e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2841566-f1c4-4ae9-85bf-666ccffcb135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1951901219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d4f7e81-840e-416f-b5f0-2cffb78b9845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4327874dbad046f1816cf4fb0150d77a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:00:14Z,use_quota=True,user_id='2c711b56e1af4a958c894e78ee7ed164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (311e38ce-8016-4e70-9de0-25ce2f2d2bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:13 devstack sudo[103223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-50e8eda5-0e06-427d-8578-2661cd78839e
Nov 05 10:00:13 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (311e38ce-8016-4e70-9de0-25ce2f2d2bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55c53f4c-857c-4683-b2dd-376eb2c6255a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55c53f4c-857c-4683-b2dd-376eb2c6255a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d4f7e81-840e-416f-b5f0-2cffb78b9845', 'volume_name': 'volume-7d4f7e81-840e-416f-b5f0-2cffb78b9845', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599b2734-1127-4e72-9766-2c2d5a7c1518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599b2734-1127-4e72-9766-2c2d5a7c1518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32851b96-7a35-4875-895f-98e69e3aa71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:13 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Volume 7d4f7e81-840e-416f-b5f0-2cffb78b9845: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d4f7e81-840e-416f-b5f0-2cffb78b9845', 'volume_size': 1}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:00:13 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-50e8eda5-0e06-427d-8578-2661cd78839e" returned: 0 in 0.264s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-532648141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c6f8730-a792-46b3-9c48-7f18adbf64f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4327874dbad046f1816cf4fb0150d77a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:00:13Z,use_quota=True,user_id='2c711b56e1af4a958c894e78ee7ed164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Creating volume 4c6f8730-a792-46b3-9c48-7f18adbf64f7 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:00:13 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-4c6f8730-a792-46b3-9c48-7f18adbf64f7 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7457c86b-3ba8-457c-aef3-6faff06317a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50e8eda5-0e06-427d-8578-2661cd78839e', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:13 devstack sudo[103226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-4c6f8730-a792-46b3-9c48-7f18adbf64f7 1073741824
Nov 05 10:00:13 devstack sudo[103226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e81f13-e36b-454e-a3d1-fd75faa6c89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:13 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] Volume volume-50e8eda5-0e06-427d-8578-2661cd78839e (50e8eda5-0e06-427d-8578-2661cd78839e): created successfully
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e81f13-e36b-454e-a3d1-fd75faa6c89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:13 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] Flow 'volume_create_manager' (2b6f4ab9-d2c6-4fb9-a53c-c49abbc5b635) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:00:13 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-6d15b161-3429-4542-89ec-2e9d5dc7c02d tempest-CreateVolumesFromSnapshotTest-1116241530 None] Created volume successfully.
Nov 05 10:00:14 devstack sudo[103226]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-4c6f8730-a792-46b3-9c48-7f18adbf64f7 1073741824" returned: 0 in 0.440s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-4c6f8730-a792-46b3-9c48-7f18adbf64f7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:14 devstack sudo[103231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-4c6f8730-a792-46b3-9c48-7f18adbf64f7
Nov 05 10:00:14 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:14 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-4c6f8730-a792-46b3-9c48-7f18adbf64f7" returned: 0 in 0.273s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:00:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:00:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.393s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:00:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1429227954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5486f0cc-e28e-4cae-93c1-d80899914ccc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4327874dbad046f1816cf4fb0150d77a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:00:13Z,use_quota=True,user_id='2c711b56e1af4a958c894e78ee7ed164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:00:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Creating volume 5486f0cc-e28e-4cae-93c1-d80899914ccc {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:00:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:00:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:00:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:00:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:00:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:00:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:00:14 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:00:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5486f0cc-e28e-4cae-93c1-d80899914ccc 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f8d256-d9f0-4a31-913a-1bd59bccf48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c6f8730-a792-46b3-9c48-7f18adbf64f7', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:14 devstack sudo[103234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5486f0cc-e28e-4cae-93c1-d80899914ccc 1073741824
Nov 05 10:00:14 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35818c59-9920-44c7-9fa8-54483158a1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:14 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Volume volume-4c6f8730-a792-46b3-9c48-7f18adbf64f7 (4c6f8730-a792-46b3-9c48-7f18adbf64f7): created successfully
Nov 05 10:00:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35818c59-9920-44c7-9fa8-54483158a1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:14 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Flow 'volume_create_manager' (0aec4da1-d5e2-4cb7-af3b-a5c94b097b40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:00:14 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-08bd6f32-5e53-427e-8a1a-bf9545893102 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Created volume successfully.
Nov 05 10:00:15 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5486f0cc-e28e-4cae-93c1-d80899914ccc 1073741824" returned: 0 in 0.424s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5486f0cc-e28e-4cae-93c1-d80899914ccc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:15 devstack sudo[103239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5486f0cc-e28e-4cae-93c1-d80899914ccc
Nov 05 10:00:15 devstack sudo[103239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:15 devstack sudo[103239]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5486f0cc-e28e-4cae-93c1-d80899914ccc" returned: 0 in 0.256s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:00:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:00:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.703s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:00:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1951901219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d4f7e81-840e-416f-b5f0-2cffb78b9845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4327874dbad046f1816cf4fb0150d77a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:00:14Z,use_quota=True,user_id='2c711b56e1af4a958c894e78ee7ed164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:00:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Creating volume 7d4f7e81-840e-416f-b5f0-2cffb78b9845 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:00:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:00:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:00:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:00:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:00:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:00:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:00:15 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:00:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d4f7e81-840e-416f-b5f0-2cffb78b9845 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7671c6a-d0e5-4cf6-951b-ac25c46145b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5486f0cc-e28e-4cae-93c1-d80899914ccc', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:15 devstack sudo[103242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d4f7e81-840e-416f-b5f0-2cffb78b9845 1073741824
Nov 05 10:00:15 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bffbf3f9-00ee-4c74-8de8-adc87259ec47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:15 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Volume volume-5486f0cc-e28e-4cae-93c1-d80899914ccc (5486f0cc-e28e-4cae-93c1-d80899914ccc): created successfully
Nov 05 10:00:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bffbf3f9-00ee-4c74-8de8-adc87259ec47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Flow 'volume_create_manager' (43717a9b-78b5-48ee-bdfe-f8dca2bca1d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:00:15 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-0e8d6151-3c4f-4e30-8f30-91502a5e67d5 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Created volume successfully.
Nov 05 10:00:15 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d4f7e81-840e-416f-b5f0-2cffb78b9845 1073741824" returned: 0 in 0.458s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d4f7e81-840e-416f-b5f0-2cffb78b9845 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:15 devstack sudo[103248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d4f7e81-840e-416f-b5f0-2cffb78b9845
Nov 05 10:00:15 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:16 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d4f7e81-840e-416f-b5f0-2cffb78b9845" returned: 0 in 0.250s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:00:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:00:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32851b96-7a35-4875-895f-98e69e3aa71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d4f7e81-840e-416f-b5f0-2cffb78b9845', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde73b72-7070-4676-b2ae-467fa1a93ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:16 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Volume volume-7d4f7e81-840e-416f-b5f0-2cffb78b9845 (7d4f7e81-840e-416f-b5f0-2cffb78b9845): created successfully
Nov 05 10:00:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde73b72-7070-4676-b2ae-467fa1a93ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Flow 'volume_create_manager' (602be856-d74b-408c-ab10-9cb784ec0dd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:00:16 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c5b1411a-1054-4c84-ba2f-dbc4ae1dce3e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Created volume successfully.
Nov 05 10:00:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f75ac786-2712-4836-ac95-fb134a9a8b17 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Acquiring lock "cinder-7d4f7e81-840e-416f-b5f0-2cffb78b9845-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:00:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f75ac786-2712-4836-ac95-fb134a9a8b17 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "cinder-7d4f7e81-840e-416f-b5f0-2cffb78b9845-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:00:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f75ac786-2712-4836-ac95-fb134a9a8b17 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Acquiring lock "cinder-quobyte-7d4f7e81-840e-416f-b5f0-2cffb78b9845" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:00:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f75ac786-2712-4836-ac95-fb134a9a8b17 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "cinder-quobyte-7d4f7e81-840e-416f-b5f0-2cffb78b9845" acquired by "delete_volume" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:00:17 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef84885b-f482-4f5c-93e0-d3e7c098d038]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:00:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f75ac786-2712-4836-ac95-fb134a9a8b17 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d4f7e81-840e-416f-b5f0-2cffb78b9845 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:17 devstack sudo[103251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d4f7e81-840e-416f-b5f0-2cffb78b9845
Nov 05 10:00:17 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:17 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f75ac786-2712-4836-ac95-fb134a9a8b17 tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d4f7e81-840e-416f-b5f0-2cffb78b9845" returned: 0 in 0.357s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f75ac786-2712-4836-ac95-fb134a9a8b17 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d4f7e81-840e-416f-b5f0-2cffb78b9845 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:17 devstack sudo[103256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d4f7e81-840e-416f-b5f0-2cffb78b9845
Nov 05 10:00:17 devstack sudo[103256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:17 devstack sudo[103256]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f75ac786-2712-4836-ac95-fb134a9a8b17 tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d4f7e81-840e-416f-b5f0-2cffb78b9845" returned: 0 in 0.270s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f75ac786-2712-4836-ac95-fb134a9a8b17 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "cinder-quobyte-7d4f7e81-840e-416f-b5f0-2cffb78b9845" released by "delete_volume" :: held 0.672s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:00:17 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-f75ac786-2712-4836-ac95-fb134a9a8b17 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Created reservations ['dab1000a-ac4b-40ff-932e-f350cc58f6a9', '93f168c9-f746-4e25-a629-9662080a787a', '2d7329d4-d53e-423b-9ceb-e84a23e64940', 'df0f7da3-7ab2-4114-94d7-247c57fe8857'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:00:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f75ac786-2712-4836-ac95-fb134a9a8b17 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:00:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f75ac786-2712-4836-ac95-fb134a9a8b17 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:00:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f75ac786-2712-4836-ac95-fb134a9a8b17 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:00:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f75ac786-2712-4836-ac95-fb134a9a8b17 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:00:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f75ac786-2712-4836-ac95-fb134a9a8b17 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:00:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f75ac786-2712-4836-ac95-fb134a9a8b17 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:17 devstack sudo[103259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:00:17 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:18 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f75ac786-2712-4836-ac95-fb134a9a8b17 tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.269s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:18 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-f75ac786-2712-4836-ac95-fb134a9a8b17 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:00:18 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f75ac786-2712-4836-ac95-fb134a9a8b17 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Deleted volume successfully.
Nov 05 10:00:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f75ac786-2712-4836-ac95-fb134a9a8b17 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "cinder-7d4f7e81-840e-416f-b5f0-2cffb78b9845-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:00:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bbabd93c-f975-4770-83f3-47c49f2720fd tempest-CreateVolumesFromSnapshotTest-1116241530 None] Acquiring lock "cinder-5486f0cc-e28e-4cae-93c1-d80899914ccc-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:00:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bbabd93c-f975-4770-83f3-47c49f2720fd tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "cinder-5486f0cc-e28e-4cae-93c1-d80899914ccc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:00:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bbabd93c-f975-4770-83f3-47c49f2720fd tempest-CreateVolumesFromSnapshotTest-1116241530 None] Acquiring lock "cinder-quobyte-5486f0cc-e28e-4cae-93c1-d80899914ccc" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:00:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bbabd93c-f975-4770-83f3-47c49f2720fd tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "cinder-quobyte-5486f0cc-e28e-4cae-93c1-d80899914ccc" acquired by "delete_volume" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:00:18 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee17f4b-1e20-4724-bd4e-df87dd39e51b]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:00:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bbabd93c-f975-4770-83f3-47c49f2720fd tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5486f0cc-e28e-4cae-93c1-d80899914ccc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:18 devstack sudo[103262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5486f0cc-e28e-4cae-93c1-d80899914ccc
Nov 05 10:00:18 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:18 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bbabd93c-f975-4770-83f3-47c49f2720fd tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5486f0cc-e28e-4cae-93c1-d80899914ccc" returned: 0 in 0.374s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bbabd93c-f975-4770-83f3-47c49f2720fd tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5486f0cc-e28e-4cae-93c1-d80899914ccc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:18 devstack sudo[103267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5486f0cc-e28e-4cae-93c1-d80899914ccc
Nov 05 10:00:18 devstack sudo[103267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:18 devstack sudo[103267]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bbabd93c-f975-4770-83f3-47c49f2720fd tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5486f0cc-e28e-4cae-93c1-d80899914ccc" returned: 0 in 0.250s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bbabd93c-f975-4770-83f3-47c49f2720fd tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "cinder-quobyte-5486f0cc-e28e-4cae-93c1-d80899914ccc" released by "delete_volume" :: held 0.664s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:00:18 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-bbabd93c-f975-4770-83f3-47c49f2720fd tempest-CreateVolumesFromSnapshotTest-1116241530 None] Created reservations ['17229f8e-ada5-4120-9c65-fdff84fbc8e7', 'a03fdd83-a608-4cf1-a91f-ba4f4a96d498', 'd6de4f42-713a-4363-a4b9-523625f261d0', '3be1e3d5-fbac-4686-813d-eff78e5d60b3'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:00:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bbabd93c-f975-4770-83f3-47c49f2720fd tempest-CreateVolumesFromSnapshotTest-1116241530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:00:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bbabd93c-f975-4770-83f3-47c49f2720fd tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:00:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-bbabd93c-f975-4770-83f3-47c49f2720fd tempest-CreateVolumesFromSnapshotTest-1116241530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:00:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-bbabd93c-f975-4770-83f3-47c49f2720fd tempest-CreateVolumesFromSnapshotTest-1116241530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:00:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bbabd93c-f975-4770-83f3-47c49f2720fd tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:00:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bbabd93c-f975-4770-83f3-47c49f2720fd tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:19 devstack sudo[103270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:00:19 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:19 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bbabd93c-f975-4770-83f3-47c49f2720fd tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.244s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:19 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-bbabd93c-f975-4770-83f3-47c49f2720fd tempest-CreateVolumesFromSnapshotTest-1116241530 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:00:19 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-bbabd93c-f975-4770-83f3-47c49f2720fd tempest-CreateVolumesFromSnapshotTest-1116241530 None] Deleted volume successfully.
Nov 05 10:00:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bbabd93c-f975-4770-83f3-47c49f2720fd tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "cinder-5486f0cc-e28e-4cae-93c1-d80899914ccc-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:00:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-61156a2c-5e99-4f4f-87c9-21144bc90f6f tempest-CreateVolumesFromSnapshotTest-1116241530 None] Acquiring lock "cinder-4c6f8730-a792-46b3-9c48-7f18adbf64f7-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:00:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-61156a2c-5e99-4f4f-87c9-21144bc90f6f tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "cinder-4c6f8730-a792-46b3-9c48-7f18adbf64f7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:00:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-61156a2c-5e99-4f4f-87c9-21144bc90f6f tempest-CreateVolumesFromSnapshotTest-1116241530 None] Acquiring lock "cinder-quobyte-4c6f8730-a792-46b3-9c48-7f18adbf64f7" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:00:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-61156a2c-5e99-4f4f-87c9-21144bc90f6f tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "cinder-quobyte-4c6f8730-a792-46b3-9c48-7f18adbf64f7" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:00:19 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b98c30-f044-4aaf-8a71-22547b9bb7a9]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:00:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-61156a2c-5e99-4f4f-87c9-21144bc90f6f tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-4c6f8730-a792-46b3-9c48-7f18adbf64f7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:19 devstack sudo[103273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-4c6f8730-a792-46b3-9c48-7f18adbf64f7
Nov 05 10:00:19 devstack sudo[103273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:19 devstack sudo[103273]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-61156a2c-5e99-4f4f-87c9-21144bc90f6f tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-4c6f8730-a792-46b3-9c48-7f18adbf64f7" returned: 0 in 0.374s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-61156a2c-5e99-4f4f-87c9-21144bc90f6f tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-4c6f8730-a792-46b3-9c48-7f18adbf64f7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:19 devstack sudo[103279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-4c6f8730-a792-46b3-9c48-7f18adbf64f7
Nov 05 10:00:19 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:20 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-61156a2c-5e99-4f4f-87c9-21144bc90f6f tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-4c6f8730-a792-46b3-9c48-7f18adbf64f7" returned: 0 in 0.249s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-61156a2c-5e99-4f4f-87c9-21144bc90f6f tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "cinder-quobyte-4c6f8730-a792-46b3-9c48-7f18adbf64f7" released by "delete_volume" :: held 0.667s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:00:20 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-61156a2c-5e99-4f4f-87c9-21144bc90f6f tempest-CreateVolumesFromSnapshotTest-1116241530 None] Created reservations ['3965c006-5d69-4f2f-b933-198574bd07e9', 'eb22f49e-7a31-4469-86ff-92cc773eaf7c', '12e4e59d-21c8-40a0-b144-3f9f4d8a7aa0', '68bfffb0-85e2-4705-8adb-705bcd8b3560'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:00:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-61156a2c-5e99-4f4f-87c9-21144bc90f6f tempest-CreateVolumesFromSnapshotTest-1116241530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:00:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-61156a2c-5e99-4f4f-87c9-21144bc90f6f tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:00:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-61156a2c-5e99-4f4f-87c9-21144bc90f6f tempest-CreateVolumesFromSnapshotTest-1116241530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:00:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-61156a2c-5e99-4f4f-87c9-21144bc90f6f tempest-CreateVolumesFromSnapshotTest-1116241530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:00:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-61156a2c-5e99-4f4f-87c9-21144bc90f6f tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:00:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-61156a2c-5e99-4f4f-87c9-21144bc90f6f tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:20 devstack sudo[103282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:00:20 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-46536e5f-6290-496f-ac17-7e60d0253a12 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Acquiring lock "cinder-50e8eda5-0e06-427d-8578-2661cd78839e-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:00:20 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-61156a2c-5e99-4f4f-87c9-21144bc90f6f tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.267s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:20 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-61156a2c-5e99-4f4f-87c9-21144bc90f6f tempest-CreateVolumesFromSnapshotTest-1116241530 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:00:20 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-61156a2c-5e99-4f4f-87c9-21144bc90f6f tempest-CreateVolumesFromSnapshotTest-1116241530 None] Deleted volume successfully.
Nov 05 10:00:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-46536e5f-6290-496f-ac17-7e60d0253a12 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "cinder-50e8eda5-0e06-427d-8578-2661cd78839e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:00:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-61156a2c-5e99-4f4f-87c9-21144bc90f6f tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "cinder-4c6f8730-a792-46b3-9c48-7f18adbf64f7-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:00:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-46536e5f-6290-496f-ac17-7e60d0253a12 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Acquiring lock "cinder-quobyte-50e8eda5-0e06-427d-8578-2661cd78839e" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:00:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-46536e5f-6290-496f-ac17-7e60d0253a12 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "cinder-quobyte-50e8eda5-0e06-427d-8578-2661cd78839e" acquired by "delete_volume" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:00:20 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[56300b7d-169b-4f3a-9406-af8918b486f6]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:00:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-46536e5f-6290-496f-ac17-7e60d0253a12 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-50e8eda5-0e06-427d-8578-2661cd78839e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:20 devstack sudo[103285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-50e8eda5-0e06-427d-8578-2661cd78839e
Nov 05 10:00:20 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:21 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-46536e5f-6290-496f-ac17-7e60d0253a12 tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-50e8eda5-0e06-427d-8578-2661cd78839e" returned: 0 in 0.387s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-46536e5f-6290-496f-ac17-7e60d0253a12 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-50e8eda5-0e06-427d-8578-2661cd78839e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:21 devstack sudo[103291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-50e8eda5-0e06-427d-8578-2661cd78839e
Nov 05 10:00:21 devstack sudo[103291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:21 devstack sudo[103291]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-46536e5f-6290-496f-ac17-7e60d0253a12 tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-50e8eda5-0e06-427d-8578-2661cd78839e" returned: 0 in 0.266s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-46536e5f-6290-496f-ac17-7e60d0253a12 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "cinder-quobyte-50e8eda5-0e06-427d-8578-2661cd78839e" released by "delete_volume" :: held 0.696s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:00:21 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-46536e5f-6290-496f-ac17-7e60d0253a12 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Created reservations ['2c08efa8-c828-450a-be3f-d1abec5206e2', 'fa416e4c-302d-4fd0-954e-ed9af785f5b9', '4fa49720-4683-473e-80bf-fc55df4ea909', '71b99047-905c-451c-9627-f3a3dbcc8cb0'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:00:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-46536e5f-6290-496f-ac17-7e60d0253a12 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:00:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-46536e5f-6290-496f-ac17-7e60d0253a12 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:00:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-46536e5f-6290-496f-ac17-7e60d0253a12 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:00:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-46536e5f-6290-496f-ac17-7e60d0253a12 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:00:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-46536e5f-6290-496f-ac17-7e60d0253a12 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:00:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-46536e5f-6290-496f-ac17-7e60d0253a12 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:21 devstack sudo[103294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:00:21 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:21 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-46536e5f-6290-496f-ac17-7e60d0253a12 tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.274s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:21 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-46536e5f-6290-496f-ac17-7e60d0253a12 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:00:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b678ab9f-cc7f-4734-b115-3c32d5f550af tempest-CreateVolumesFromSnapshotTest-1116241530 None] Acquiring lock "cinder-971a4211-dfb6-479d-9627-66441abc5edc-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:00:21 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-46536e5f-6290-496f-ac17-7e60d0253a12 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Deleted volume successfully.
Nov 05 10:00:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b678ab9f-cc7f-4734-b115-3c32d5f550af tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "cinder-971a4211-dfb6-479d-9627-66441abc5edc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:00:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-46536e5f-6290-496f-ac17-7e60d0253a12 tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "cinder-50e8eda5-0e06-427d-8578-2661cd78839e-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:00:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b678ab9f-cc7f-4734-b115-3c32d5f550af tempest-CreateVolumesFromSnapshotTest-1116241530 None] Acquiring lock "cinder-quobyte-971a4211-dfb6-479d-9627-66441abc5edc" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:00:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b678ab9f-cc7f-4734-b115-3c32d5f550af tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "cinder-quobyte-971a4211-dfb6-479d-9627-66441abc5edc" acquired by "delete_volume" :: waited 0.013s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:00:21 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1dd3ead-cb4f-4f09-8de4-c4e0ef9c9033]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:00:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b678ab9f-cc7f-4734-b115-3c32d5f550af tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-971a4211-dfb6-479d-9627-66441abc5edc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:21 devstack sudo[103297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-971a4211-dfb6-479d-9627-66441abc5edc
Nov 05 10:00:21 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:22 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b678ab9f-cc7f-4734-b115-3c32d5f550af tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-971a4211-dfb6-479d-9627-66441abc5edc" returned: 0 in 0.371s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b678ab9f-cc7f-4734-b115-3c32d5f550af tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-971a4211-dfb6-479d-9627-66441abc5edc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:22 devstack sudo[103302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-971a4211-dfb6-479d-9627-66441abc5edc
Nov 05 10:00:22 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:22 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b678ab9f-cc7f-4734-b115-3c32d5f550af tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-971a4211-dfb6-479d-9627-66441abc5edc" returned: 0 in 0.261s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b678ab9f-cc7f-4734-b115-3c32d5f550af tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "cinder-quobyte-971a4211-dfb6-479d-9627-66441abc5edc" released by "delete_volume" :: held 0.672s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:00:22 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-b678ab9f-cc7f-4734-b115-3c32d5f550af tempest-CreateVolumesFromSnapshotTest-1116241530 None] Created reservations ['1d9a894d-7143-405c-a64a-1e6ecf2d301c', 'be6ef9cf-3e6c-4309-ba4e-b8782fcd0dde', '22bdbae6-d94a-4948-a415-3598cdde799f', '4371b3b8-5d43-4b99-89b2-48a4665073a6'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:00:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b678ab9f-cc7f-4734-b115-3c32d5f550af tempest-CreateVolumesFromSnapshotTest-1116241530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:00:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b678ab9f-cc7f-4734-b115-3c32d5f550af tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:00:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b678ab9f-cc7f-4734-b115-3c32d5f550af tempest-CreateVolumesFromSnapshotTest-1116241530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:00:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b678ab9f-cc7f-4734-b115-3c32d5f550af tempest-CreateVolumesFromSnapshotTest-1116241530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:00:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b678ab9f-cc7f-4734-b115-3c32d5f550af tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:00:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b678ab9f-cc7f-4734-b115-3c32d5f550af tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:22 devstack sudo[103305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:00:22 devstack sudo[103305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:22 devstack sudo[103305]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5011121e-fe31-41cc-8ac2-a524d1d9859e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Acquiring lock "cinder-527df2b5-1045-4ee6-a340-979234ffedf0-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:00:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b678ab9f-cc7f-4734-b115-3c32d5f550af tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.275s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:22 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-b678ab9f-cc7f-4734-b115-3c32d5f550af tempest-CreateVolumesFromSnapshotTest-1116241530 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:00:22 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b678ab9f-cc7f-4734-b115-3c32d5f550af tempest-CreateVolumesFromSnapshotTest-1116241530 None] Deleted volume successfully.
Nov 05 10:00:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5011121e-fe31-41cc-8ac2-a524d1d9859e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "cinder-527df2b5-1045-4ee6-a340-979234ffedf0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:00:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5011121e-fe31-41cc-8ac2-a524d1d9859e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Acquiring lock "cinder-quobyte-6e07415f-6282-4102-b635-5183c998609b" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:00:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-b678ab9f-cc7f-4734-b115-3c32d5f550af tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "cinder-971a4211-dfb6-479d-9627-66441abc5edc-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:00:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5011121e-fe31-41cc-8ac2-a524d1d9859e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "cinder-quobyte-6e07415f-6282-4102-b635-5183c998609b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:00:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5011121e-fe31-41cc-8ac2-a524d1d9859e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Acquiring lock "cinder-quobyte-527df2b5-1045-4ee6-a340-979234ffedf0" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:00:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5011121e-fe31-41cc-8ac2-a524d1d9859e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "cinder-quobyte-527df2b5-1045-4ee6-a340-979234ffedf0" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:00:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-5011121e-fe31-41cc-8ac2-a524d1d9859e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Deleting offline snapshot 527df2b5-1045-4ee6-a340-979234ffedf0 of volume 6e07415f-6282-4102-b635-5183c998609b {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 10:00:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-5011121e-fe31-41cc-8ac2-a524d1d9859e tempest-CreateVolumesFromSnapshotTest-1116241530 None] snapshot_file for this snap is: volume-6e07415f-6282-4102-b635-5183c998609b.527df2b5-1045-4ee6-a340-979234ffedf0 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 10:00:22 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[e457c131-b549-413b-baa5-5733de40e9ea]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:00:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5011121e-fe31-41cc-8ac2-a524d1d9859e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b.527df2b5-1045-4ee6-a340-979234ffedf0 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:23 devstack sudo[103308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b.527df2b5-1045-4ee6-a340-979234ffedf0
Nov 05 10:00:23 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:23 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5011121e-fe31-41cc-8ac2-a524d1d9859e tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b.527df2b5-1045-4ee6-a340-979234ffedf0" returned: 0 in 0.376s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-5011121e-fe31-41cc-8ac2-a524d1d9859e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e07415f-6282-4102-b635-5183c998609b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 10:00:23 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[490d6503-6780-4c7c-ba38-d3938b3a31dd]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:00:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5011121e-fe31-41cc-8ac2-a524d1d9859e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:23 devstack sudo[103313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b
Nov 05 10:00:23 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:23 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5011121e-fe31-41cc-8ac2-a524d1d9859e tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b" returned: 0 in 0.380s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5011121e-fe31-41cc-8ac2-a524d1d9859e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b.527df2b5-1045-4ee6-a340-979234ffedf0 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:23 devstack sudo[103318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b.527df2b5-1045-4ee6-a340-979234ffedf0
Nov 05 10:00:23 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:24 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5011121e-fe31-41cc-8ac2-a524d1d9859e tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b.527df2b5-1045-4ee6-a340-979234ffedf0" returned: 0 in 0.356s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5011121e-fe31-41cc-8ac2-a524d1d9859e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b.527df2b5-1045-4ee6-a340-979234ffedf0 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:24 devstack sudo[103323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b.527df2b5-1045-4ee6-a340-979234ffedf0
Nov 05 10:00:24 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:24 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5011121e-fe31-41cc-8ac2-a524d1d9859e tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b.527df2b5-1045-4ee6-a340-979234ffedf0" returned: 0 in 0.255s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:24 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5011121e-fe31-41cc-8ac2-a524d1d9859e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "cinder-quobyte-527df2b5-1045-4ee6-a340-979234ffedf0" released by "_delete_snapshot" :: held 1.472s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:00:24 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5011121e-fe31-41cc-8ac2-a524d1d9859e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "cinder-quobyte-6e07415f-6282-4102-b635-5183c998609b" released by "delete_snapshot" :: held 1.493s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:00:24 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-5011121e-fe31-41cc-8ac2-a524d1d9859e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Created reservations ['31ad8197-147b-48df-8035-8c1713bb7c58', '90a510d7-7beb-4d5d-bfda-7db4d703acb5', '520c4ed1-8c2b-497d-9d77-acb01fd06abe', '8f2dfd3b-6c56-4140-bd76-4063d4cba460'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:00:24 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-5011121e-fe31-41cc-8ac2-a524d1d9859e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Delete snapshot completed successfully.
Nov 05 10:00:24 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5011121e-fe31-41cc-8ac2-a524d1d9859e tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "cinder-527df2b5-1045-4ee6-a340-979234ffedf0-delete_snapshot" released by "delete_snapshot" :: held 1.644s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:00:25 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fb497817-046c-4699-9eb3-4d630ca9abff tempest-CreateVolumesFromSnapshotTest-1116241530 None] Acquiring lock "cinder-6e07415f-6282-4102-b635-5183c998609b-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:00:25 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fb497817-046c-4699-9eb3-4d630ca9abff tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "cinder-6e07415f-6282-4102-b635-5183c998609b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:00:25 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fb497817-046c-4699-9eb3-4d630ca9abff tempest-CreateVolumesFromSnapshotTest-1116241530 None] Acquiring lock "cinder-quobyte-6e07415f-6282-4102-b635-5183c998609b" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:00:25 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fb497817-046c-4699-9eb3-4d630ca9abff tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "cinder-quobyte-6e07415f-6282-4102-b635-5183c998609b" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:00:25 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[876b570b-4355-4406-8ed7-565e79a02b47]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:00:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fb497817-046c-4699-9eb3-4d630ca9abff tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:25 devstack sudo[103327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b
Nov 05 10:00:25 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:25 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fb497817-046c-4699-9eb3-4d630ca9abff tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b" returned: 0 in 0.368s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fb497817-046c-4699-9eb3-4d630ca9abff tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:25 devstack sudo[103332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b
Nov 05 10:00:25 devstack sudo[103332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:25 devstack sudo[103332]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fb497817-046c-4699-9eb3-4d630ca9abff tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6e07415f-6282-4102-b635-5183c998609b" returned: 0 in 0.251s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:25 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fb497817-046c-4699-9eb3-4d630ca9abff tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "cinder-quobyte-6e07415f-6282-4102-b635-5183c998609b" released by "delete_volume" :: held 0.685s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:00:25 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-fb497817-046c-4699-9eb3-4d630ca9abff tempest-CreateVolumesFromSnapshotTest-1116241530 None] Created reservations ['27c05145-cb1e-4c18-9f8e-06a18f3011cd', 'f338bd2e-3d38-4e43-9d0e-c1c1a544b54e', 'c4244bcd-95db-4bcc-8292-6dcd3affe26f', '57c890f8-94ce-493a-939c-1778128c83ea'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:00:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fb497817-046c-4699-9eb3-4d630ca9abff tempest-CreateVolumesFromSnapshotTest-1116241530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:00:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fb497817-046c-4699-9eb3-4d630ca9abff tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:00:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fb497817-046c-4699-9eb3-4d630ca9abff tempest-CreateVolumesFromSnapshotTest-1116241530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:00:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fb497817-046c-4699-9eb3-4d630ca9abff tempest-CreateVolumesFromSnapshotTest-1116241530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:00:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fb497817-046c-4699-9eb3-4d630ca9abff tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:00:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fb497817-046c-4699-9eb3-4d630ca9abff tempest-CreateVolumesFromSnapshotTest-1116241530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:25 devstack sudo[103335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:00:25 devstack sudo[103335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:26 devstack sudo[103335]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fb497817-046c-4699-9eb3-4d630ca9abff tempest-CreateVolumesFromSnapshotTest-1116241530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.268s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:26 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-fb497817-046c-4699-9eb3-4d630ca9abff tempest-CreateVolumesFromSnapshotTest-1116241530 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:00:26 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-fb497817-046c-4699-9eb3-4d630ca9abff tempest-CreateVolumesFromSnapshotTest-1116241530 None] Deleted volume successfully.
Nov 05 10:00:26 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fb497817-046c-4699-9eb3-4d630ca9abff tempest-CreateVolumesFromSnapshotTest-1116241530 None] Lock "cinder-6e07415f-6282-4102-b635-5183c998609b-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:00:29 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:00:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] Flow 'volume_create_manager' (56a53eeb-f60b-4aa6-97d9-9a4d114a18f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:00:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f68433-84de-4cd3-922c-dac9ac986ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f68433-84de-4cd3-922c-dac9ac986ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1763770911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47f4115f-65d9-4209-b76d-a4f08500de96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcbc9b36f1e64cb28f0ef920aaa57102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:00:29Z,use_quota=True,user_id='085e27f6fd864a04b56df62d88c10dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f0aeb92-3078-4f2b-b3e0-da847648bba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f0aeb92-3078-4f2b-b3e0-da847648bba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9def01a9-3ec6-4181-9357-f66b0fd4f5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9def01a9-3ec6-4181-9357-f66b0fd4f5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47f4115f-65d9-4209-b76d-a4f08500de96', 'volume_name': 'volume-47f4115f-65d9-4209-b76d-a4f08500de96', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eb3e5d3-1d64-49f9-8801-6d9269dd529c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eb3e5d3-1d64-49f9-8801-6d9269dd529c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78320ef2-8a45-46e3-84d9-697240b85ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:29 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] Volume 47f4115f-65d9-4209-b76d-a4f08500de96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47f4115f-65d9-4209-b76d-a4f08500de96', 'volume_size': 1}
Nov 05 10:00:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:00:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:00:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1763770911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47f4115f-65d9-4209-b76d-a4f08500de96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcbc9b36f1e64cb28f0ef920aaa57102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:00:29Z,use_quota=True,user_id='085e27f6fd864a04b56df62d88c10dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:00:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] Creating volume 47f4115f-65d9-4209-b76d-a4f08500de96 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:00:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:00:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:00:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:00:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:00:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:00:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:00:29 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:00:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:29 devstack sudo[103340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96 1073741824
Nov 05 10:00:29 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:29 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96 1073741824" returned: 0 in 0.431s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:29 devstack sudo[103345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96
Nov 05 10:00:29 devstack sudo[103345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:29 devstack sudo[103345]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96" returned: 0 in 0.247s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:00:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:00:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78320ef2-8a45-46e3-84d9-697240b85ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47f4115f-65d9-4209-b76d-a4f08500de96', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c630b7-a00f-427c-b1a7-65341144d495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:29 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] Volume volume-47f4115f-65d9-4209-b76d-a4f08500de96 (47f4115f-65d9-4209-b76d-a4f08500de96): created successfully
Nov 05 10:00:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c630b7-a00f-427c-b1a7-65341144d495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] Flow 'volume_create_manager' (56a53eeb-f60b-4aa6-97d9-9a4d114a18f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:00:29 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-187cf475-7e5b-4717-b802-e1c35b4f074e tempest-VolumeDependencyTests-36883658 None] Created volume successfully.
Nov 05 10:00:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3f8eb9a6-8279-4e7e-b8d6-a45680ec68e4 tempest-VolumeDependencyTests-36883658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:00:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3f8eb9a6-8279-4e7e-b8d6-a45680ec68e4 tempest-VolumeDependencyTests-36883658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:00:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-3f8eb9a6-8279-4e7e-b8d6-a45680ec68e4 tempest-VolumeDependencyTests-36883658 None] Creating offline snapshot aa812e23-8b34-4057-aa2f-20c5baf6aa7c of volume 47f4115f-65d9-4209-b76d-a4f08500de96 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 10:00:30 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[9031151d-e63c-4558-b6c4-2f927cd767a8]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:00:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3f8eb9a6-8279-4e7e-b8d6-a45680ec68e4 tempest-VolumeDependencyTests-36883658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:30 devstack sudo[103349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96
Nov 05 10:00:30 devstack sudo[103349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:30 devstack sudo[103349]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3f8eb9a6-8279-4e7e-b8d6-a45680ec68e4 tempest-VolumeDependencyTests-36883658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96" returned: 0 in 0.395s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3f8eb9a6-8279-4e7e-b8d6-a45680ec68e4 tempest-VolumeDependencyTests-36883658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96.aa812e23-8b34-4057-aa2f-20c5baf6aa7c 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:30 devstack sudo[103354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96.aa812e23-8b34-4057-aa2f-20c5baf6aa7c 1G
Nov 05 10:00:30 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:31 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3f8eb9a6-8279-4e7e-b8d6-a45680ec68e4 tempest-VolumeDependencyTests-36883658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96.aa812e23-8b34-4057-aa2f-20c5baf6aa7c 1G" returned: 0 in 0.413s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3f8eb9a6-8279-4e7e-b8d6-a45680ec68e4 tempest-VolumeDependencyTests-36883658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47f4115f-65d9-4209-b76d-a4f08500de96 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96.aa812e23-8b34-4057-aa2f-20c5baf6aa7c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:31 devstack sudo[103359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47f4115f-65d9-4209-b76d-a4f08500de96 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96.aa812e23-8b34-4057-aa2f-20c5baf6aa7c
Nov 05 10:00:31 devstack sudo[103359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:31 devstack sudo[103359]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3f8eb9a6-8279-4e7e-b8d6-a45680ec68e4 tempest-VolumeDependencyTests-36883658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47f4115f-65d9-4209-b76d-a4f08500de96 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96.aa812e23-8b34-4057-aa2f-20c5baf6aa7c" returned: 0 in 0.331s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:31 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-3f8eb9a6-8279-4e7e-b8d6-a45680ec68e4 tempest-VolumeDependencyTests-36883658 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96.aa812e23-8b34-4057-aa2f-20c5baf6aa7c is being set with open permissions: ugo+rw
Nov 05 10:00:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3f8eb9a6-8279-4e7e-b8d6-a45680ec68e4 tempest-VolumeDependencyTests-36883658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96.aa812e23-8b34-4057-aa2f-20c5baf6aa7c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:31 devstack sudo[103366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96.aa812e23-8b34-4057-aa2f-20c5baf6aa7c
Nov 05 10:00:31 devstack sudo[103366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:31 devstack sudo[103366]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3f8eb9a6-8279-4e7e-b8d6-a45680ec68e4 tempest-VolumeDependencyTests-36883658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96.aa812e23-8b34-4057-aa2f-20c5baf6aa7c" returned: 0 in 0.267s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3f8eb9a6-8279-4e7e-b8d6-a45680ec68e4 tempest-VolumeDependencyTests-36883658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:31 devstack sudo[103369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96.info
Nov 05 10:00:31 devstack sudo[103369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:31 devstack sudo[103369]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3f8eb9a6-8279-4e7e-b8d6-a45680ec68e4 tempest-VolumeDependencyTests-36883658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96.info" returned: 0 in 0.274s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:31 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-3f8eb9a6-8279-4e7e-b8d6-a45680ec68e4 tempest-VolumeDependencyTests-36883658 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96.info is being set with open permissions: ugo+rw
Nov 05 10:00:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3f8eb9a6-8279-4e7e-b8d6-a45680ec68e4 tempest-VolumeDependencyTests-36883658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:32 devstack sudo[103372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96.info
Nov 05 10:00:32 devstack sudo[103372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:32 devstack sudo[103372]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3f8eb9a6-8279-4e7e-b8d6-a45680ec68e4 tempest-VolumeDependencyTests-36883658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96.info" returned: 0 in 0.252s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3f8eb9a6-8279-4e7e-b8d6-a45680ec68e4 tempest-VolumeDependencyTests-36883658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.034s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:00:32 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-3f8eb9a6-8279-4e7e-b8d6-a45680ec68e4 tempest-VolumeDependencyTests-36883658 None] Create snapshot completed successfully
Nov 05 10:00:33 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:00:33 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Flow 'volume_create_manager' (2267a74d-a9d9-4197-abad-a7c3b993f89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:00:33 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc7b25f8-cac7-424e-9d40-5ac9c6132072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:33 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc7b25f8-cac7-424e-9d40-5ac9c6132072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1434682397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc734866-1d9d-4523-9372-2a0847b82400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcbc9b36f1e64cb28f0ef920aaa57102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aa812e23-8b34-4057-aa2f-20c5baf6aa7c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:00:34Z,use_quota=True,user_id='085e27f6fd864a04b56df62d88c10dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:33 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57eecf73-ae81-4d35-b3f3-0f52d60a7182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:33 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57eecf73-ae81-4d35-b3f3-0f52d60a7182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:33 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9eff44f-7cfc-46d7-a5c1-a0f16dea3356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:33 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9eff44f-7cfc-46d7-a5c1-a0f16dea3356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fc734866-1d9d-4523-9372-2a0847b82400', 'volume_name': 'volume-fc734866-1d9d-4523-9372-2a0847b82400', 'volume_size': 1, 'snapshot_id': 'aa812e23-8b34-4057-aa2f-20c5baf6aa7c'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:33 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd58c24-f815-4293-a996-f4ecfb1b9ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:33 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd58c24-f815-4293-a996-f4ecfb1b9ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (696d4cc4-b1e4-4a91-80b8-626c372db247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:34 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Volume fc734866-1d9d-4523-9372-2a0847b82400: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fc734866-1d9d-4523-9372-2a0847b82400', 'volume_size': 1, 'snapshot_id': 'aa812e23-8b34-4057-aa2f-20c5baf6aa7c'}
Nov 05 10:00:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:00:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:00:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Acquiring lock "cinder-quobyte-aa812e23-8b34-4057-aa2f-20c5baf6aa7c-fc734866-1d9d-4523-9372-2a0847b82400" by "_create_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:00:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Lock "cinder-quobyte-aa812e23-8b34-4057-aa2f-20c5baf6aa7c-fc734866-1d9d-4523-9372-2a0847b82400" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:00:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Creating volume fc734866-1d9d-4523-9372-2a0847b82400 from snapshot aa812e23-8b34-4057-aa2f-20c5baf6aa7c {{(pid=86649) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 10:00:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:00:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:00:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:00:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:00:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:00:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:00:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Acquiring lock "cinder-quobyte-fc734866-1d9d-4523-9372-2a0847b82400" by "_copy_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:00:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Lock "cinder-quobyte-fc734866-1d9d-4523-9372-2a0847b82400" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:00:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] snapshot: aa812e23-8b34-4057-aa2f-20c5baf6aa7c, volume: fc734866-1d9d-4523-9372-2a0847b82400,  {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 10:00:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:00:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:00:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:00:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:00:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:00:34 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[89713053-cc7b-493a-b64a-f5ec7813e22f]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:00:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96.aa812e23-8b34-4057-aa2f-20c5baf6aa7c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:34 devstack sudo[103375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96.aa812e23-8b34-4057-aa2f-20c5baf6aa7c
Nov 05 10:00:34 devstack sudo[103375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:34 devstack sudo[103375]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96.aa812e23-8b34-4057-aa2f-20c5baf6aa7c" returned: 0 in 0.379s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47f4115f-65d9-4209-b76d-a4f08500de96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 10:00:34 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[2190b8f4-8c0d-4213-a84d-e1170d0af5ff]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:00:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:34 devstack sudo[103380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96
Nov 05 10:00:34 devstack sudo[103380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:34 devstack sudo[103380]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96" returned: 0 in 0.389s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96 {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 10:00:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Creating direct copy from snapshot {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 10:00:34 devstack cinder-volume[86649]: DEBUG cinder.utils [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Path /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc734866-1d9d-4523-9372-2a0847b82400 not found in is_blk_device check {{(pid=86649) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 10:00:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc734866-1d9d-4523-9372-2a0847b82400 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:34 devstack sudo[103385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc734866-1d9d-4523-9372-2a0847b82400
Nov 05 10:00:34 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:40 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc734866-1d9d-4523-9372-2a0847b82400" returned: 0 in 6.054s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:40 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Image conversion details: src /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96, size 1024.00 MB, duration 6.06 sec, destination /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc734866-1d9d-4523-9372-2a0847b82400 {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 10:00:40 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Converted 1024.00 MB image at 169.11 MB/s
Nov 05 10:00:40 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc734866-1d9d-4523-9372-2a0847b82400 is being set with open permissions: ugo+rw
Nov 05 10:00:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc734866-1d9d-4523-9372-2a0847b82400 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:40 devstack sudo[103399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc734866-1d9d-4523-9372-2a0847b82400
Nov 05 10:00:40 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:41 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc734866-1d9d-4523-9372-2a0847b82400" returned: 0 in 0.257s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Lock "cinder-quobyte-fc734866-1d9d-4523-9372-2a0847b82400" released by "_copy_volume_from_snapshot" :: held 7.162s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:00:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Lock "cinder-quobyte-aa812e23-8b34-4057-aa2f-20c5baf6aa7c-fc734866-1d9d-4523-9372-2a0847b82400" released by "_create_volume_from_snapshot" :: held 7.229s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:00:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.246s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:00:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (696d4cc4-b1e4-4a91-80b8-626c372db247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc734866-1d9d-4523-9372-2a0847b82400', 'volume_size': 1, 'snapshot_id': 'aa812e23-8b34-4057-aa2f-20c5baf6aa7c'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c7b6a73-7270-4d5c-b1bf-b47a622a0607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:41 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Volume volume-fc734866-1d9d-4523-9372-2a0847b82400 (fc734866-1d9d-4523-9372-2a0847b82400): created successfully
Nov 05 10:00:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c7b6a73-7270-4d5c-b1bf-b47a622a0607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Flow 'volume_create_manager' (2267a74d-a9d9-4197-abad-a7c3b993f89e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:00:41 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-600aa994-061d-43fd-8b77-4761d96e3b77 tempest-VolumeDependencyTests-36883658 None] Created volume successfully.
Nov 05 10:00:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-015f0d56-d75d-4d22-8908-1500e393768b tempest-VolumeDependencyTests-36883658 None] Acquiring lock "cinder-aa812e23-8b34-4057-aa2f-20c5baf6aa7c-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:00:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-015f0d56-d75d-4d22-8908-1500e393768b tempest-VolumeDependencyTests-36883658 None] Lock "cinder-aa812e23-8b34-4057-aa2f-20c5baf6aa7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:00:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-015f0d56-d75d-4d22-8908-1500e393768b tempest-VolumeDependencyTests-36883658 None] Acquiring lock "cinder-quobyte-47f4115f-65d9-4209-b76d-a4f08500de96" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:00:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-015f0d56-d75d-4d22-8908-1500e393768b tempest-VolumeDependencyTests-36883658 None] Lock "cinder-quobyte-47f4115f-65d9-4209-b76d-a4f08500de96" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:00:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-015f0d56-d75d-4d22-8908-1500e393768b tempest-VolumeDependencyTests-36883658 None] Acquiring lock "cinder-quobyte-aa812e23-8b34-4057-aa2f-20c5baf6aa7c" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:00:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-015f0d56-d75d-4d22-8908-1500e393768b tempest-VolumeDependencyTests-36883658 None] Lock "cinder-quobyte-aa812e23-8b34-4057-aa2f-20c5baf6aa7c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:00:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-015f0d56-d75d-4d22-8908-1500e393768b tempest-VolumeDependencyTests-36883658 None] Deleting offline snapshot aa812e23-8b34-4057-aa2f-20c5baf6aa7c of volume 47f4115f-65d9-4209-b76d-a4f08500de96 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 10:00:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-015f0d56-d75d-4d22-8908-1500e393768b tempest-VolumeDependencyTests-36883658 None] snapshot_file for this snap is: volume-47f4115f-65d9-4209-b76d-a4f08500de96.aa812e23-8b34-4057-aa2f-20c5baf6aa7c {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 10:00:41 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa0516d-4af6-445d-b6a1-175ac45a108a]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:00:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-015f0d56-d75d-4d22-8908-1500e393768b tempest-VolumeDependencyTests-36883658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96.aa812e23-8b34-4057-aa2f-20c5baf6aa7c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:41 devstack sudo[103402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96.aa812e23-8b34-4057-aa2f-20c5baf6aa7c
Nov 05 10:00:41 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:41 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-015f0d56-d75d-4d22-8908-1500e393768b tempest-VolumeDependencyTests-36883658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96.aa812e23-8b34-4057-aa2f-20c5baf6aa7c" returned: 0 in 0.381s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-015f0d56-d75d-4d22-8908-1500e393768b tempest-VolumeDependencyTests-36883658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47f4115f-65d9-4209-b76d-a4f08500de96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 10:00:41 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0d636c-dd6b-41cd-a23c-0c0522772f5f]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:00:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-015f0d56-d75d-4d22-8908-1500e393768b tempest-VolumeDependencyTests-36883658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:42 devstack sudo[103414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96
Nov 05 10:00:42 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:42 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-015f0d56-d75d-4d22-8908-1500e393768b tempest-VolumeDependencyTests-36883658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96" returned: 0 in 0.551s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-015f0d56-d75d-4d22-8908-1500e393768b tempest-VolumeDependencyTests-36883658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96.aa812e23-8b34-4057-aa2f-20c5baf6aa7c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:42 devstack sudo[103419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96.aa812e23-8b34-4057-aa2f-20c5baf6aa7c
Nov 05 10:00:42 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:42 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-015f0d56-d75d-4d22-8908-1500e393768b tempest-VolumeDependencyTests-36883658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96.aa812e23-8b34-4057-aa2f-20c5baf6aa7c" returned: 0 in 0.338s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-015f0d56-d75d-4d22-8908-1500e393768b tempest-VolumeDependencyTests-36883658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96.aa812e23-8b34-4057-aa2f-20c5baf6aa7c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:42 devstack sudo[103424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96.aa812e23-8b34-4057-aa2f-20c5baf6aa7c
Nov 05 10:00:42 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:43 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-015f0d56-d75d-4d22-8908-1500e393768b tempest-VolumeDependencyTests-36883658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96.aa812e23-8b34-4057-aa2f-20c5baf6aa7c" returned: 0 in 0.259s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-015f0d56-d75d-4d22-8908-1500e393768b tempest-VolumeDependencyTests-36883658 None] Lock "cinder-quobyte-aa812e23-8b34-4057-aa2f-20c5baf6aa7c" released by "_delete_snapshot" :: held 1.648s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:00:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-015f0d56-d75d-4d22-8908-1500e393768b tempest-VolumeDependencyTests-36883658 None] Lock "cinder-quobyte-47f4115f-65d9-4209-b76d-a4f08500de96" released by "delete_snapshot" :: held 1.674s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:00:43 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-015f0d56-d75d-4d22-8908-1500e393768b tempest-VolumeDependencyTests-36883658 None] Created reservations ['28009be2-8806-48b9-8bd5-99880673601f', 'e53693eb-7fd5-46f5-85a6-de43d7915d9c', 'f9476a70-7628-4c60-b8c1-e0ef43128697', 'fb273780-6500-42fb-8395-4aa0914c7b2c'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:00:43 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-015f0d56-d75d-4d22-8908-1500e393768b tempest-VolumeDependencyTests-36883658 None] Delete snapshot completed successfully.
Nov 05 10:00:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-015f0d56-d75d-4d22-8908-1500e393768b tempest-VolumeDependencyTests-36883658 None] Lock "cinder-aa812e23-8b34-4057-aa2f-20c5baf6aa7c-delete_snapshot" released by "delete_snapshot" :: held 1.812s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:00:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9ecd24ee-f322-4bfa-b5c1-1a80e56a887a tempest-VolumeDependencyTests-36883658 None] Acquiring lock "cinder-47f4115f-65d9-4209-b76d-a4f08500de96-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:00:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9ecd24ee-f322-4bfa-b5c1-1a80e56a887a tempest-VolumeDependencyTests-36883658 None] Lock "cinder-47f4115f-65d9-4209-b76d-a4f08500de96-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:00:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9ecd24ee-f322-4bfa-b5c1-1a80e56a887a tempest-VolumeDependencyTests-36883658 None] Acquiring lock "cinder-quobyte-47f4115f-65d9-4209-b76d-a4f08500de96" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:00:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9ecd24ee-f322-4bfa-b5c1-1a80e56a887a tempest-VolumeDependencyTests-36883658 None] Lock "cinder-quobyte-47f4115f-65d9-4209-b76d-a4f08500de96" acquired by "delete_volume" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:00:43 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[1051914f-855c-4140-8ef2-c08a7f700c62]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:00:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9ecd24ee-f322-4bfa-b5c1-1a80e56a887a tempest-VolumeDependencyTests-36883658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:43 devstack sudo[103427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96
Nov 05 10:00:43 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:44 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9ecd24ee-f322-4bfa-b5c1-1a80e56a887a tempest-VolumeDependencyTests-36883658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96" returned: 0 in 0.367s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9ecd24ee-f322-4bfa-b5c1-1a80e56a887a tempest-VolumeDependencyTests-36883658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:44 devstack sudo[103432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96
Nov 05 10:00:44 devstack sudo[103432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:44 devstack sudo[103432]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9ecd24ee-f322-4bfa-b5c1-1a80e56a887a tempest-VolumeDependencyTests-36883658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-47f4115f-65d9-4209-b76d-a4f08500de96" returned: 0 in 0.245s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9ecd24ee-f322-4bfa-b5c1-1a80e56a887a tempest-VolumeDependencyTests-36883658 None] Lock "cinder-quobyte-47f4115f-65d9-4209-b76d-a4f08500de96" released by "delete_volume" :: held 0.675s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:00:44 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-9ecd24ee-f322-4bfa-b5c1-1a80e56a887a tempest-VolumeDependencyTests-36883658 None] Created reservations ['a50d1bde-acf0-44c8-a723-aea0685873f5', 'e53d1182-7063-416c-bffd-5ae73f9277ca', '1546974c-486f-48dc-82e3-4b69e1600f88', 'b53101a7-3d76-4671-9d0a-b99d24e82494'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:00:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9ecd24ee-f322-4bfa-b5c1-1a80e56a887a tempest-VolumeDependencyTests-36883658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:00:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9ecd24ee-f322-4bfa-b5c1-1a80e56a887a tempest-VolumeDependencyTests-36883658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:00:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9ecd24ee-f322-4bfa-b5c1-1a80e56a887a tempest-VolumeDependencyTests-36883658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:00:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9ecd24ee-f322-4bfa-b5c1-1a80e56a887a tempest-VolumeDependencyTests-36883658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:00:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9ecd24ee-f322-4bfa-b5c1-1a80e56a887a tempest-VolumeDependencyTests-36883658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:00:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9ecd24ee-f322-4bfa-b5c1-1a80e56a887a tempest-VolumeDependencyTests-36883658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:44 devstack sudo[103435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:00:44 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:44 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9ecd24ee-f322-4bfa-b5c1-1a80e56a887a tempest-VolumeDependencyTests-36883658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.278s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:44 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-9ecd24ee-f322-4bfa-b5c1-1a80e56a887a tempest-VolumeDependencyTests-36883658 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:00:44 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-9ecd24ee-f322-4bfa-b5c1-1a80e56a887a tempest-VolumeDependencyTests-36883658 None] Deleted volume successfully.
Nov 05 10:00:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fa06c25c-514f-4759-bddc-ad3e446ca5bc tempest-VolumeDependencyTests-36883658 None] Acquiring lock "cinder-fc734866-1d9d-4523-9372-2a0847b82400-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:00:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9ecd24ee-f322-4bfa-b5c1-1a80e56a887a tempest-VolumeDependencyTests-36883658 None] Lock "cinder-47f4115f-65d9-4209-b76d-a4f08500de96-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:00:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fa06c25c-514f-4759-bddc-ad3e446ca5bc tempest-VolumeDependencyTests-36883658 None] Lock "cinder-fc734866-1d9d-4523-9372-2a0847b82400-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:00:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fa06c25c-514f-4759-bddc-ad3e446ca5bc tempest-VolumeDependencyTests-36883658 None] Acquiring lock "cinder-quobyte-fc734866-1d9d-4523-9372-2a0847b82400" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:00:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fa06c25c-514f-4759-bddc-ad3e446ca5bc tempest-VolumeDependencyTests-36883658 None] Lock "cinder-quobyte-fc734866-1d9d-4523-9372-2a0847b82400" acquired by "delete_volume" :: waited 0.013s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:00:44 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[df379982-1e6a-4e8e-af9c-e243dc59de16]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:00:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fa06c25c-514f-4759-bddc-ad3e446ca5bc tempest-VolumeDependencyTests-36883658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc734866-1d9d-4523-9372-2a0847b82400 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:45 devstack sudo[103438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc734866-1d9d-4523-9372-2a0847b82400
Nov 05 10:00:45 devstack sudo[103438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:45 devstack sudo[103438]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fa06c25c-514f-4759-bddc-ad3e446ca5bc tempest-VolumeDependencyTests-36883658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc734866-1d9d-4523-9372-2a0847b82400" returned: 0 in 0.372s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fa06c25c-514f-4759-bddc-ad3e446ca5bc tempest-VolumeDependencyTests-36883658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc734866-1d9d-4523-9372-2a0847b82400 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:45 devstack sudo[103443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc734866-1d9d-4523-9372-2a0847b82400
Nov 05 10:00:45 devstack sudo[103443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:45 devstack sudo[103443]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fa06c25c-514f-4759-bddc-ad3e446ca5bc tempest-VolumeDependencyTests-36883658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc734866-1d9d-4523-9372-2a0847b82400" returned: 0 in 0.267s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fa06c25c-514f-4759-bddc-ad3e446ca5bc tempest-VolumeDependencyTests-36883658 None] Lock "cinder-quobyte-fc734866-1d9d-4523-9372-2a0847b82400" released by "delete_volume" :: held 0.681s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:00:45 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-fa06c25c-514f-4759-bddc-ad3e446ca5bc tempest-VolumeDependencyTests-36883658 None] Created reservations ['712d4b16-cc97-4636-bded-61f265a78d44', '57a04fa2-15ef-4d8a-ade9-96629a4e3c4e', '6c88d6ee-0729-4c41-bd75-6ce5a4afd355', 'f127306b-2953-4827-b98c-6ff73aca039d'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:00:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fa06c25c-514f-4759-bddc-ad3e446ca5bc tempest-VolumeDependencyTests-36883658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:00:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fa06c25c-514f-4759-bddc-ad3e446ca5bc tempest-VolumeDependencyTests-36883658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:00:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fa06c25c-514f-4759-bddc-ad3e446ca5bc tempest-VolumeDependencyTests-36883658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:00:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fa06c25c-514f-4759-bddc-ad3e446ca5bc tempest-VolumeDependencyTests-36883658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:00:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fa06c25c-514f-4759-bddc-ad3e446ca5bc tempest-VolumeDependencyTests-36883658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:00:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fa06c25c-514f-4759-bddc-ad3e446ca5bc tempest-VolumeDependencyTests-36883658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:45 devstack sudo[103446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:00:45 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:45 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fa06c25c-514f-4759-bddc-ad3e446ca5bc tempest-VolumeDependencyTests-36883658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.278s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:45 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-fa06c25c-514f-4759-bddc-ad3e446ca5bc tempest-VolumeDependencyTests-36883658 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:00:46 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-fa06c25c-514f-4759-bddc-ad3e446ca5bc tempest-VolumeDependencyTests-36883658 None] Deleted volume successfully.
Nov 05 10:00:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-fa06c25c-514f-4759-bddc-ad3e446ca5bc tempest-VolumeDependencyTests-36883658 None] Lock "cinder-fc734866-1d9d-4523-9372-2a0847b82400-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:00:51 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:00:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Flow 'volume_create_manager' (9048ffd2-ab71-48d0-846d-aefb02698716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:00:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4425802-c93e-42b8-9f70-c77245a4cd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4425802-c93e-42b8-9f70-c77245a4cd64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4d14b8b-f36e-40ab-a758-80827df6cdc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec160b7a1e3f4240a6cc69305d822c1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:00:51Z,use_quota=True,user_id='8339ad8573404627a4f02c053d3121cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4aa41c7-fcec-4ef4-bb17-8a596090f214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4aa41c7-fcec-4ef4-bb17-8a596090f214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98797536-276b-4353-b3fe-02ab017952f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:51 devstack cinder-volume[86649]: DEBUG cinder.image.glance [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Creating Keystone auth plugin from conf {{(pid=86649) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 10:00:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98797536-276b-4353-b3fe-02ab017952f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd4d14b8b-f36e-40ab-a758-80827df6cdc9', 'volume_name': 'volume-d4d14b8b-f36e-40ab-a758-80827df6cdc9', 'volume_size': 1, 'image_id': 'c99fbf9a-2145-4807-a303-a6ade299b761', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c99fbf9a-2145-4807-a303-a6ade299b761', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '32d1da6bee351a0d8dfb881b65b4dab1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ec160b7a1e3f4240a6cc69305d822c1c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '71d58802ae696289225d9458532c13eadcd53cdde255bdb9b4233266161391cb072bcde6b6f3b374178f4e492ecbd9e76b4c3dd21bf0e78f37b946b82fec17bc', 'id': 'c99fbf9a-2145-4807-a303-a6ade299b761', 'created_at': datetime.datetime(2026, 11, 5, 9, 0, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 9, 0, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c99fbf9a-2145-4807-a303-a6ade299b761/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7841a654a3c0>}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adadebcb-9b2b-410f-b9a0-a93d4b980865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adadebcb-9b2b-410f-b9a0-a93d4b980865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531f8c77-09c1-46c1-981b-59aa1f1b3f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:51 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Volume d4d14b8b-f36e-40ab-a758-80827df6cdc9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d4d14b8b-f36e-40ab-a758-80827df6cdc9', 'volume_size': 1, 'image_id': 'c99fbf9a-2145-4807-a303-a6ade299b761', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c99fbf9a-2145-4807-a303-a6ade299b761', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '32d1da6bee351a0d8dfb881b65b4dab1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ec160b7a1e3f4240a6cc69305d822c1c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '71d58802ae696289225d9458532c13eadcd53cdde255bdb9b4233266161391cb072bcde6b6f3b374178f4e492ecbd9e76b4c3dd21bf0e78f37b946b82fec17bc', 'id': 'c99fbf9a-2145-4807-a303-a6ade299b761', 'created_at': datetime.datetime(2026, 11, 5, 9, 0, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 9, 0, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c99fbf9a-2145-4807-a303-a6ade299b761/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7841a654a3c0>}
Nov 05 10:00:51 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Trying to clone d4d14b8b-f36e-40ab-a758-80827df6cdc9 from image c99fbf9a-2145-4807-a303-a6ade299b761 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c99fbf9a-2145-4807-a303-a6ade299b761', 'metadata': {}}]). {{(pid=86649) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 10:00:51 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c99fbf9a-2145-4807-a303-a6ade299b761_qo6nc5oidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 10:00:51 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 10:00:51 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[416d06f8-5031-49af-8aba-0fb3fb0cc921]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:00:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c99fbf9a-2145-4807-a303-a6ade299b761_qo6nc5oidevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:51 devstack sudo[103486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c99fbf9a-2145-4807-a303-a6ade299b761_qo6nc5oidevstack@QuobyteHD
Nov 05 10:00:51 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:52 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c99fbf9a-2145-4807-a303-a6ade299b761_qo6nc5oidevstack@QuobyteHD" returned: 0 in 0.333s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c99fbf9a-2145-4807-a303-a6ade299b761_qo6nc5oidevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:52 devstack sudo[103491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c99fbf9a-2145-4807-a303-a6ade299b761_qo6nc5oidevstack@QuobyteHD
Nov 05 10:00:52 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:52 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c99fbf9a-2145-4807-a303-a6ade299b761_qo6nc5oidevstack@QuobyteHD" returned: 1 in 0.350s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c99fbf9a-2145-4807-a303-a6ade299b761_qo6nc5oidevstack@QuobyteHD' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 10:00:52 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Temporary image c99fbf9a-2145-4807-a303-a6ade299b761 is fetched for user 8339ad8573404627a4f02c053d3121cd. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 10:00:52 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d299ed-5e6e-4f90-aee5-5d81672af213]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:00:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c99fbf9a-2145-4807-a303-a6ade299b761_qo6nc5oidevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:52 devstack sudo[103496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c99fbf9a-2145-4807-a303-a6ade299b761_qo6nc5oidevstack@QuobyteHD
Nov 05 10:00:52 devstack sudo[103496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:52 devstack sudo[103496]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c99fbf9a-2145-4807-a303-a6ade299b761_qo6nc5oidevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c99fbf9a-2145-4807-a303-a6ade299b761_qo6nc5oidevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:53 devstack sudo[103500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c99fbf9a-2145-4807-a303-a6ade299b761_qo6nc5oidevstack@QuobyteHD
Nov 05 10:00:53 devstack sudo[103500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:53 devstack sudo[103500]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c99fbf9a-2145-4807-a303-a6ade299b761_qo6nc5oidevstack@QuobyteHD" returned: 1 in 0.344s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c99fbf9a-2145-4807-a303-a6ade299b761_qo6nc5oidevstack@QuobyteHD' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 10:00:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:00:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:00:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4d14b8b-f36e-40ab-a758-80827df6cdc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec160b7a1e3f4240a6cc69305d822c1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:00:51Z,use_quota=True,user_id='8339ad8573404627a4f02c053d3121cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:00:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Creating volume d4d14b8b-f36e-40ab-a758-80827df6cdc9 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:00:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:00:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:00:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:00:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:00:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:00:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:00:53 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:00:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d4d14b8b-f36e-40ab-a758-80827df6cdc9 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:53 devstack sudo[103505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d4d14b8b-f36e-40ab-a758-80827df6cdc9 1073741824
Nov 05 10:00:53 devstack sudo[103505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:53 devstack sudo[103505]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d4d14b8b-f36e-40ab-a758-80827df6cdc9 1073741824" returned: 0 in 0.440s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d4d14b8b-f36e-40ab-a758-80827df6cdc9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:53 devstack sudo[103511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d4d14b8b-f36e-40ab-a758-80827df6cdc9
Nov 05 10:00:53 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:54 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d4d14b8b-f36e-40ab-a758-80827df6cdc9" returned: 0 in 0.263s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:00:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:00:54 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Attempting download of c99fbf9a-2145-4807-a303-a6ade299b761 ((None, [{'url': 'file:///opt/stack/data/glance/images/c99fbf9a-2145-4807-a303-a6ade299b761', 'metadata': {}}])) to volume d4d14b8b-f36e-40ab-a758-80827df6cdc9. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 10:00:54 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a76965-b325-454b-9281-9ecfa99a244b]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:00:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c99fbf9a-2145-4807-a303-a6ade299b761_80wpu6nz {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:54 devstack sudo[103514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c99fbf9a-2145-4807-a303-a6ade299b761_80wpu6nz
Nov 05 10:00:54 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:54 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c99fbf9a-2145-4807-a303-a6ade299b761_80wpu6nz" returned: 0 in 0.343s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c99fbf9a-2145-4807-a303-a6ade299b761_80wpu6nz {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:54 devstack sudo[103518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c99fbf9a-2145-4807-a303-a6ade299b761_80wpu6nz
Nov 05 10:00:54 devstack sudo[103518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:54 devstack sudo[103518]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c99fbf9a-2145-4807-a303-a6ade299b761_80wpu6nz" returned: 1 in 0.327s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c99fbf9a-2145-4807-a303-a6ade299b761_80wpu6nz' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 10:00:54 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d6961f-836b-4e64-901a-560e3ca0be0a]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:00:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c99fbf9a-2145-4807-a303-a6ade299b761_qo6nc5oidevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:54 devstack sudo[103522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c99fbf9a-2145-4807-a303-a6ade299b761_qo6nc5oidevstack@QuobyteHD
Nov 05 10:00:54 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:55 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c99fbf9a-2145-4807-a303-a6ade299b761_qo6nc5oidevstack@QuobyteHD" returned: 0 in 0.322s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c99fbf9a-2145-4807-a303-a6ade299b761_qo6nc5oidevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:55 devstack sudo[103526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c99fbf9a-2145-4807-a303-a6ade299b761_qo6nc5oidevstack@QuobyteHD
Nov 05 10:00:55 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:55 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c99fbf9a-2145-4807-a303-a6ade299b761_qo6nc5oidevstack@QuobyteHD" returned: 1 in 0.344s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c99fbf9a-2145-4807-a303-a6ade299b761_qo6nc5oidevstack@QuobyteHD' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 10:00:55 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] c99fbf9a-2145-4807-a303-a6ade299b761 was raw, converting to qcow2 {{(pid=86649) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 10:00:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c99fbf9a-2145-4807-a303-a6ade299b761_qo6nc5oidevstack@QuobyteHD /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d4d14b8b-f36e-40ab-a758-80827df6cdc9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:55 devstack sudo[103531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c99fbf9a-2145-4807-a303-a6ade299b761_qo6nc5oidevstack@QuobyteHD /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d4d14b8b-f36e-40ab-a758-80827df6cdc9
Nov 05 10:00:55 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:55 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c99fbf9a-2145-4807-a303-a6ade299b761_qo6nc5oidevstack@QuobyteHD /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d4d14b8b-f36e-40ab-a758-80827df6cdc9" returned: 0 in 0.437s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:55 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c99fbf9a-2145-4807-a303-a6ade299b761_qo6nc5oidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d4d14b8b-f36e-40ab-a758-80827df6cdc9 {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 10:00:55 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 10:00:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d4d14b8b-f36e-40ab-a758-80827df6cdc9 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:55 devstack sudo[103536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d4d14b8b-f36e-40ab-a758-80827df6cdc9 1G
Nov 05 10:00:55 devstack sudo[103536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:56 devstack sudo[103536]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d4d14b8b-f36e-40ab-a758-80827df6cdc9 1G" returned: 0 in 0.303s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:56 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Downloaded image c99fbf9a-2145-4807-a303-a6ade299b761 ((None, [{'url': 'file:///opt/stack/data/glance/images/c99fbf9a-2145-4807-a303-a6ade299b761', 'metadata': {}}])) to volume d4d14b8b-f36e-40ab-a758-80827df6cdc9 successfully. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 10:00:56 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Temporary image c99fbf9a-2145-4807-a303-a6ade299b761 for user 8339ad8573404627a4f02c053d3121cd is deleted. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 10:00:56 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Marking volume d4d14b8b-f36e-40ab-a758-80827df6cdc9 as bootable. {{(pid=86649) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 10:00:56 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Copying metadata from image c99fbf9a-2145-4807-a303-a6ade299b761 to d4d14b8b-f36e-40ab-a758-80827df6cdc9. {{(pid=86649) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 10:00:56 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Creating volume glance metadata for volume d4d14b8b-f36e-40ab-a758-80827df6cdc9 backed by image c99fbf9a-2145-4807-a303-a6ade299b761 with: {'image_id': 'c99fbf9a-2145-4807-a303-a6ade299b761', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '32d1da6bee351a0d8dfb881b65b4dab1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86649) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 10:00:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531f8c77-09c1-46c1-981b-59aa1f1b3f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4d14b8b-f36e-40ab-a758-80827df6cdc9', 'volume_size': 1, 'image_id': 'c99fbf9a-2145-4807-a303-a6ade299b761', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c99fbf9a-2145-4807-a303-a6ade299b761', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '32d1da6bee351a0d8dfb881b65b4dab1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ec160b7a1e3f4240a6cc69305d822c1c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '71d58802ae696289225d9458532c13eadcd53cdde255bdb9b4233266161391cb072bcde6b6f3b374178f4e492ecbd9e76b4c3dd21bf0e78f37b946b82fec17bc', 'id': 'c99fbf9a-2145-4807-a303-a6ade299b761', 'created_at': datetime.datetime(2026, 11, 5, 9, 0, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 9, 0, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c99fbf9a-2145-4807-a303-a6ade299b761/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7841a654a3c0>}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87507af1-8890-4081-bf7c-4b3d009f70ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:00:56 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Volume volume-d4d14b8b-f36e-40ab-a758-80827df6cdc9 (d4d14b8b-f36e-40ab-a758-80827df6cdc9): created successfully
Nov 05 10:00:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87507af1-8890-4081-bf7c-4b3d009f70ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:00:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Flow 'volume_create_manager' (9048ffd2-ab71-48d0-846d-aefb02698716) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:00:56 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-217f71de-2d91-4f16-b18b-23e4fa0b5328 tempest-VolumeImageDependencyTests-762881797 None] Created volume successfully.
Nov 05 10:00:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0c8651a1-ff56-4c2d-9e22-2f7916de02ca tempest-VolumeImageDependencyTests-762881797 None] Acquiring lock "cinder-d4d14b8b-f36e-40ab-a758-80827df6cdc9-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:00:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0c8651a1-ff56-4c2d-9e22-2f7916de02ca tempest-VolumeImageDependencyTests-762881797 None] Lock "cinder-d4d14b8b-f36e-40ab-a758-80827df6cdc9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:00:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0c8651a1-ff56-4c2d-9e22-2f7916de02ca tempest-VolumeImageDependencyTests-762881797 None] Acquiring lock "cinder-quobyte-d4d14b8b-f36e-40ab-a758-80827df6cdc9" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:00:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0c8651a1-ff56-4c2d-9e22-2f7916de02ca tempest-VolumeImageDependencyTests-762881797 None] Lock "cinder-quobyte-d4d14b8b-f36e-40ab-a758-80827df6cdc9" acquired by "delete_volume" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:00:56 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f9c24d-6760-4e63-8c50-1260580ca1ae]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:00:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0c8651a1-ff56-4c2d-9e22-2f7916de02ca tempest-VolumeImageDependencyTests-762881797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d4d14b8b-f36e-40ab-a758-80827df6cdc9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:56 devstack sudo[103542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d4d14b8b-f36e-40ab-a758-80827df6cdc9
Nov 05 10:00:56 devstack sudo[103542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:57 devstack sudo[103542]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0c8651a1-ff56-4c2d-9e22-2f7916de02ca tempest-VolumeImageDependencyTests-762881797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d4d14b8b-f36e-40ab-a758-80827df6cdc9" returned: 0 in 0.382s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0c8651a1-ff56-4c2d-9e22-2f7916de02ca tempest-VolumeImageDependencyTests-762881797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d4d14b8b-f36e-40ab-a758-80827df6cdc9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:57 devstack sudo[103547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d4d14b8b-f36e-40ab-a758-80827df6cdc9
Nov 05 10:00:57 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:57 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0c8651a1-ff56-4c2d-9e22-2f7916de02ca tempest-VolumeImageDependencyTests-762881797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d4d14b8b-f36e-40ab-a758-80827df6cdc9" returned: 0 in 0.261s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0c8651a1-ff56-4c2d-9e22-2f7916de02ca tempest-VolumeImageDependencyTests-762881797 None] Lock "cinder-quobyte-d4d14b8b-f36e-40ab-a758-80827df6cdc9" released by "delete_volume" :: held 0.683s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:00:57 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-0c8651a1-ff56-4c2d-9e22-2f7916de02ca tempest-VolumeImageDependencyTests-762881797 None] Created reservations ['7c15b1d6-7d98-40a2-9386-0dd12afdf29b', '01f73ef4-04a1-4d13-93fe-b38d72a85563', 'ed7870e9-d7f8-41d1-a2fb-f63dda8b0a02', '87b2a78a-7422-444a-a87a-0ed8809ad3ec'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:00:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0c8651a1-ff56-4c2d-9e22-2f7916de02ca tempest-VolumeImageDependencyTests-762881797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:00:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0c8651a1-ff56-4c2d-9e22-2f7916de02ca tempest-VolumeImageDependencyTests-762881797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:00:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0c8651a1-ff56-4c2d-9e22-2f7916de02ca tempest-VolumeImageDependencyTests-762881797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:00:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0c8651a1-ff56-4c2d-9e22-2f7916de02ca tempest-VolumeImageDependencyTests-762881797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:00:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0c8651a1-ff56-4c2d-9e22-2f7916de02ca tempest-VolumeImageDependencyTests-762881797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:00:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0c8651a1-ff56-4c2d-9e22-2f7916de02ca tempest-VolumeImageDependencyTests-762881797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:00:57 devstack sudo[103550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:00:57 devstack sudo[103550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:00:57 devstack sudo[103550]: pam_unix(sudo:session): session closed for user root
Nov 05 10:00:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0c8651a1-ff56-4c2d-9e22-2f7916de02ca tempest-VolumeImageDependencyTests-762881797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.259s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:00:57 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-0c8651a1-ff56-4c2d-9e22-2f7916de02ca tempest-VolumeImageDependencyTests-762881797 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:00:57 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-0c8651a1-ff56-4c2d-9e22-2f7916de02ca tempest-VolumeImageDependencyTests-762881797 None] Deleted volume successfully.
Nov 05 10:00:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0c8651a1-ff56-4c2d-9e22-2f7916de02ca tempest-VolumeImageDependencyTests-762881797 None] Lock "cinder-d4d14b8b-f36e-40ab-a758-80827df6cdc9-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 10:01:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:00 devstack sudo[103555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:01:00 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:00 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.266s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:01:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 10:01:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 28 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 10:01:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>, <Thread(tpool_thread_0, started daemon 132223357408960)>, <Thread(tpool_thread_1, started daemon 132223349016256)>, <Thread(tpool_thread_2, started daemon 132223340623552)>, <Thread(tpool_thread_3, started daemon 132223332230848)>, <Thread(tpool_thread_4, started daemon 132223323838144)>, <Thread(tpool_thread_5, started daemon 132223315445440)>, <Thread(tpool_thread_6, started daemon 132223307052736)>, <Thread(tpool_thread_7, started daemon 132223298660032)>, <Thread(tpool_thread_8, started daemon 132223290250944)>, <Thread(tpool_thread_9, started daemon 132223281841856)>, <Thread(tpool_thread_10, started daemon 132223273432768)>, <Thread(tpool_thread_11, started daemon 132223265023680)>, <Thread(tpool_thread_12, started daemon 132223256614592)>, <Thread(tpool_thread_13, started daemon 132223248205504)>, <Thread(tpool_thread_14, started daemon 132223239796416)>, <Thread(tpool_thread_15, started daemon 132223231387328)>, <Thread(tpool_thread_16, started daemon 132223222978240)>, <Thread(tpool_thread_17, started daemon 132223214569152)>, <Thread(tpool_thread_18, started daemon 132223206160064)>, <Thread(tpool_thread_19, started daemon 132223197750976)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 10:01:01 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:01:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] Flow 'volume_create_manager' (3f5f2347-a3d0-46cd-9c95-0d9d92f7a53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff3bde8d-3dd9-423d-a39b-fd85d707178e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff3bde8d-3dd9-423d-a39b-fd85d707178e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2126145799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=854ac144-ea74-4969-9166-f9b500580cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b774dbf78246e7852dbc5383953520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:02Z,use_quota=True,user_id='6d30134c6aa940639200e7ad7ed49b97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6e82e10-b046-4756-95e7-e5bbde189682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6e82e10-b046-4756-95e7-e5bbde189682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b10e88-3473-4ad1-bb3a-0ec0e2fc1dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b10e88-3473-4ad1-bb3a-0ec0e2fc1dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '854ac144-ea74-4969-9166-f9b500580cfa', 'volume_name': 'volume-854ac144-ea74-4969-9166-f9b500580cfa', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac4bee33-c71d-451e-bdc4-cad5b808bafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac4bee33-c71d-451e-bdc4-cad5b808bafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:01 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d769402-7095-458b-adc1-a370e6937054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:01 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] Volume 854ac144-ea74-4969-9166-f9b500580cfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-854ac144-ea74-4969-9166-f9b500580cfa', 'volume_size': 1}
Nov 05 10:01:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2126145799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=854ac144-ea74-4969-9166-f9b500580cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b774dbf78246e7852dbc5383953520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:02Z,use_quota=True,user_id='6d30134c6aa940639200e7ad7ed49b97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:01:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] Creating volume 854ac144-ea74-4969-9166-f9b500580cfa {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:01:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:01 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:01:01 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:01:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-854ac144-ea74-4969-9166-f9b500580cfa 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:01 devstack sudo[103559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-854ac144-ea74-4969-9166-f9b500580cfa 1073741824
Nov 05 10:01:01 devstack sudo[103559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:02 devstack sudo[103559]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-854ac144-ea74-4969-9166-f9b500580cfa 1073741824" returned: 0 in 0.435s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-854ac144-ea74-4969-9166-f9b500580cfa {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:02 devstack sudo[103564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-854ac144-ea74-4969-9166-f9b500580cfa
Nov 05 10:01:02 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:02 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-854ac144-ea74-4969-9166-f9b500580cfa" returned: 0 in 0.243s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:01:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d769402-7095-458b-adc1-a370e6937054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-854ac144-ea74-4969-9166-f9b500580cfa', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf0a1ba-4343-4c05-a048-22ef88c10694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:02 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] Volume volume-854ac144-ea74-4969-9166-f9b500580cfa (854ac144-ea74-4969-9166-f9b500580cfa): created successfully
Nov 05 10:01:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf0a1ba-4343-4c05-a048-22ef88c10694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] Flow 'volume_create_manager' (3f5f2347-a3d0-46cd-9c95-0d9d92f7a53a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:02 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-7d5ab1b0-962c-4f14-8158-93651a5ef58a tempest-ProjectReaderTests-1988192057 None] Created volume successfully.
Nov 05 10:01:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2181d830-1b1a-481b-80be-cd6a6f0fb43b tempest-ProjectReaderTests-1988192057 None] Acquiring lock "cinder-854ac144-ea74-4969-9166-f9b500580cfa-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2181d830-1b1a-481b-80be-cd6a6f0fb43b tempest-ProjectReaderTests-1988192057 None] Lock "cinder-854ac144-ea74-4969-9166-f9b500580cfa-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2181d830-1b1a-481b-80be-cd6a6f0fb43b tempest-ProjectReaderTests-1988192057 None] Acquiring lock "cinder-quobyte-854ac144-ea74-4969-9166-f9b500580cfa" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2181d830-1b1a-481b-80be-cd6a6f0fb43b tempest-ProjectReaderTests-1988192057 None] Lock "cinder-quobyte-854ac144-ea74-4969-9166-f9b500580cfa" acquired by "delete_volume" :: waited 0.013s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:02 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d699643-fd10-4d94-b290-3b924ccb7428]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:01:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2181d830-1b1a-481b-80be-cd6a6f0fb43b tempest-ProjectReaderTests-1988192057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-854ac144-ea74-4969-9166-f9b500580cfa {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:03 devstack sudo[103567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-854ac144-ea74-4969-9166-f9b500580cfa
Nov 05 10:01:03 devstack sudo[103567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:03 devstack sudo[103567]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2181d830-1b1a-481b-80be-cd6a6f0fb43b tempest-ProjectReaderTests-1988192057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-854ac144-ea74-4969-9166-f9b500580cfa" returned: 0 in 0.351s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2181d830-1b1a-481b-80be-cd6a6f0fb43b tempest-ProjectReaderTests-1988192057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-854ac144-ea74-4969-9166-f9b500580cfa {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:03 devstack sudo[103572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-854ac144-ea74-4969-9166-f9b500580cfa
Nov 05 10:01:03 devstack sudo[103572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:03 devstack sudo[103572]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2181d830-1b1a-481b-80be-cd6a6f0fb43b tempest-ProjectReaderTests-1988192057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-854ac144-ea74-4969-9166-f9b500580cfa" returned: 0 in 0.257s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2181d830-1b1a-481b-80be-cd6a6f0fb43b tempest-ProjectReaderTests-1988192057 None] Lock "cinder-quobyte-854ac144-ea74-4969-9166-f9b500580cfa" released by "delete_volume" :: held 0.650s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:03 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-2181d830-1b1a-481b-80be-cd6a6f0fb43b tempest-ProjectReaderTests-1988192057 None] Created reservations ['eb20c38e-daf0-469f-a909-a32c786a7037', '313c68d1-e2a2-49f2-8ea3-1f9d87bb9c63', '84896219-18c4-4f90-b3e4-494e1f13d312', 'c89087fe-7848-43a0-a410-a5d6bd38a31d'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:01:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2181d830-1b1a-481b-80be-cd6a6f0fb43b tempest-ProjectReaderTests-1988192057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2181d830-1b1a-481b-80be-cd6a6f0fb43b tempest-ProjectReaderTests-1988192057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2181d830-1b1a-481b-80be-cd6a6f0fb43b tempest-ProjectReaderTests-1988192057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2181d830-1b1a-481b-80be-cd6a6f0fb43b tempest-ProjectReaderTests-1988192057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2181d830-1b1a-481b-80be-cd6a6f0fb43b tempest-ProjectReaderTests-1988192057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2181d830-1b1a-481b-80be-cd6a6f0fb43b tempest-ProjectReaderTests-1988192057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:03 devstack sudo[103575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:01:03 devstack sudo[103575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:03 devstack sudo[103575]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2181d830-1b1a-481b-80be-cd6a6f0fb43b tempest-ProjectReaderTests-1988192057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.270s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:03 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-2181d830-1b1a-481b-80be-cd6a6f0fb43b tempest-ProjectReaderTests-1988192057 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:01:03 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-2181d830-1b1a-481b-80be-cd6a6f0fb43b tempest-ProjectReaderTests-1988192057 None] Deleted volume successfully.
Nov 05 10:01:04 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2181d830-1b1a-481b-80be-cd6a6f0fb43b tempest-ProjectReaderTests-1988192057 None] Lock "cinder-854ac144-ea74-4969-9166-f9b500580cfa-delete_volume" released by "delete_volume" :: held 1.129s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:04 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:01:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] Flow 'volume_create_manager' (f979b799-0498-4ca9-a725-89f5ac8af2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7191a34-8e04-4841-af36-f175972032fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7191a34-8e04-4841-af36-f175972032fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-138618129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dfdfea6-dd4d-4021-9454-0d5f523992d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b774dbf78246e7852dbc5383953520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:04Z,use_quota=True,user_id='6d30134c6aa940639200e7ad7ed49b97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81103503-4303-4c34-a075-1b8bf2498eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81103503-4303-4c34-a075-1b8bf2498eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f289bc92-6fff-4a3d-8cbd-3af15be97bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f289bc92-6fff-4a3d-8cbd-3af15be97bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dfdfea6-dd4d-4021-9454-0d5f523992d6', 'volume_name': 'volume-5dfdfea6-dd4d-4021-9454-0d5f523992d6', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0baf8e0e-a383-4568-b3c5-68c75e7f9f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0baf8e0e-a383-4568-b3c5-68c75e7f9f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:04 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b84d20d8-9384-42b8-88c7-171139482533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:04 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] Volume 5dfdfea6-dd4d-4021-9454-0d5f523992d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dfdfea6-dd4d-4021-9454-0d5f523992d6', 'volume_size': 1}
Nov 05 10:01:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-138618129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dfdfea6-dd4d-4021-9454-0d5f523992d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b774dbf78246e7852dbc5383953520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:04Z,use_quota=True,user_id='6d30134c6aa940639200e7ad7ed49b97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:01:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] Creating volume 5dfdfea6-dd4d-4021-9454-0d5f523992d6 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:01:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:01:04 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:01:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5dfdfea6-dd4d-4021-9454-0d5f523992d6 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:04 devstack sudo[103578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5dfdfea6-dd4d-4021-9454-0d5f523992d6 1073741824
Nov 05 10:01:04 devstack sudo[103578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:04 devstack sudo[103578]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5dfdfea6-dd4d-4021-9454-0d5f523992d6 1073741824" returned: 0 in 0.403s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5dfdfea6-dd4d-4021-9454-0d5f523992d6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:05 devstack sudo[103584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5dfdfea6-dd4d-4021-9454-0d5f523992d6
Nov 05 10:01:05 devstack sudo[103584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:05 devstack sudo[103584]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5dfdfea6-dd4d-4021-9454-0d5f523992d6" returned: 0 in 0.246s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:05 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:01:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:05 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b84d20d8-9384-42b8-88c7-171139482533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dfdfea6-dd4d-4021-9454-0d5f523992d6', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:05 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2cde858-68d7-489f-8880-b1b26449eb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:05 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] Volume volume-5dfdfea6-dd4d-4021-9454-0d5f523992d6 (5dfdfea6-dd4d-4021-9454-0d5f523992d6): created successfully
Nov 05 10:01:05 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2cde858-68d7-489f-8880-b1b26449eb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:05 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] Flow 'volume_create_manager' (f979b799-0498-4ca9-a725-89f5ac8af2f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:05 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b30461dd-9bb6-4700-ad7b-873e057214ac tempest-ProjectReaderTests-1988192057 None] Created volume successfully.
Nov 05 10:01:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9a8b111d-1afe-4f30-af09-4de500e52c78 tempest-ProjectReaderTests-1988192057 None] Acquiring lock "cinder-5dfdfea6-dd4d-4021-9454-0d5f523992d6-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9a8b111d-1afe-4f30-af09-4de500e52c78 tempest-ProjectReaderTests-1988192057 None] Lock "cinder-5dfdfea6-dd4d-4021-9454-0d5f523992d6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9a8b111d-1afe-4f30-af09-4de500e52c78 tempest-ProjectReaderTests-1988192057 None] Acquiring lock "cinder-quobyte-5dfdfea6-dd4d-4021-9454-0d5f523992d6" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9a8b111d-1afe-4f30-af09-4de500e52c78 tempest-ProjectReaderTests-1988192057 None] Lock "cinder-quobyte-5dfdfea6-dd4d-4021-9454-0d5f523992d6" acquired by "delete_volume" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:05 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fe7b65-0035-481e-9c12-e82fe427677b]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:01:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9a8b111d-1afe-4f30-af09-4de500e52c78 tempest-ProjectReaderTests-1988192057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5dfdfea6-dd4d-4021-9454-0d5f523992d6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:05 devstack sudo[103587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5dfdfea6-dd4d-4021-9454-0d5f523992d6
Nov 05 10:01:05 devstack sudo[103587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:06 devstack sudo[103587]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9a8b111d-1afe-4f30-af09-4de500e52c78 tempest-ProjectReaderTests-1988192057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5dfdfea6-dd4d-4021-9454-0d5f523992d6" returned: 0 in 0.376s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9a8b111d-1afe-4f30-af09-4de500e52c78 tempest-ProjectReaderTests-1988192057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5dfdfea6-dd4d-4021-9454-0d5f523992d6 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:06 devstack sudo[103592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5dfdfea6-dd4d-4021-9454-0d5f523992d6
Nov 05 10:01:06 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:06 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9a8b111d-1afe-4f30-af09-4de500e52c78 tempest-ProjectReaderTests-1988192057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5dfdfea6-dd4d-4021-9454-0d5f523992d6" returned: 0 in 0.249s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9a8b111d-1afe-4f30-af09-4de500e52c78 tempest-ProjectReaderTests-1988192057 None] Lock "cinder-quobyte-5dfdfea6-dd4d-4021-9454-0d5f523992d6" released by "delete_volume" :: held 0.667s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:06 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=95,cinder:UPDATE=131,cinder:INSERT=38,cinder:DELETE=10 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 10:01:06 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-9a8b111d-1afe-4f30-af09-4de500e52c78 tempest-ProjectReaderTests-1988192057 None] Created reservations ['b4725eee-400f-4de4-9f5e-af875b49dd5e', '4c0479ab-8fb9-4270-bdf1-625bf3bf32bd', '8215f5d4-d2ff-481f-b0c0-80497bb7879d', 'ca34d3f1-2fa6-45c1-b418-01c8e89bd8c8'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:01:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9a8b111d-1afe-4f30-af09-4de500e52c78 tempest-ProjectReaderTests-1988192057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9a8b111d-1afe-4f30-af09-4de500e52c78 tempest-ProjectReaderTests-1988192057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9a8b111d-1afe-4f30-af09-4de500e52c78 tempest-ProjectReaderTests-1988192057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9a8b111d-1afe-4f30-af09-4de500e52c78 tempest-ProjectReaderTests-1988192057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9a8b111d-1afe-4f30-af09-4de500e52c78 tempest-ProjectReaderTests-1988192057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9a8b111d-1afe-4f30-af09-4de500e52c78 tempest-ProjectReaderTests-1988192057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:06 devstack sudo[103595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:01:06 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:06 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9a8b111d-1afe-4f30-af09-4de500e52c78 tempest-ProjectReaderTests-1988192057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.255s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:06 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-9a8b111d-1afe-4f30-af09-4de500e52c78 tempest-ProjectReaderTests-1988192057 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:01:06 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-9a8b111d-1afe-4f30-af09-4de500e52c78 tempest-ProjectReaderTests-1988192057 None] Deleted volume successfully.
Nov 05 10:01:06 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=137,cinder:SELECT=108,cinder:INSERT=36,cinder:DELETE=14 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 10:01:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9a8b111d-1afe-4f30-af09-4de500e52c78 tempest-ProjectReaderTests-1988192057 None] Lock "cinder-5dfdfea6-dd4d-4021-9454-0d5f523992d6-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:16 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=6,cinder:SELECT=2 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 10:01:19 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:01:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] Flow 'volume_create_manager' (538b767b-0a0c-4646-acfe-c09dd4ea6db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a5fdbe6-f382-4e57-83b4-28d3da67fb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a5fdbe6-f382-4e57-83b4-28d3da67fb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1960850867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a28508e-a766-486c-a1a4-6492b6c1a05c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='818eba8a7d7044d99f976244633bd2e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:19Z,use_quota=True,user_id='6728f8d617f240b0a33dfb9758764bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5de180d6-5789-4d87-88a2-00fd2891bd7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5de180d6-5789-4d87-88a2-00fd2891bd7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e37ecfd8-dc58-48c9-930c-4361043db098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e37ecfd8-dc58-48c9-930c-4361043db098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a28508e-a766-486c-a1a4-6492b6c1a05c', 'volume_name': 'volume-1a28508e-a766-486c-a1a4-6492b6c1a05c', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2910acad-6da7-4a96-b3da-c002fe2267f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2910acad-6da7-4a96-b3da-c002fe2267f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a61b41f6-1696-46a2-a30d-d7866fb45862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:19 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] Volume 1a28508e-a766-486c-a1a4-6492b6c1a05c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a28508e-a766-486c-a1a4-6492b6c1a05c', 'volume_size': 1}
Nov 05 10:01:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1960850867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a28508e-a766-486c-a1a4-6492b6c1a05c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='818eba8a7d7044d99f976244633bd2e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:19Z,use_quota=True,user_id='6728f8d617f240b0a33dfb9758764bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:01:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] Creating volume 1a28508e-a766-486c-a1a4-6492b6c1a05c {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:01:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:01:19 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:01:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:19 devstack sudo[103635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c 1073741824
Nov 05 10:01:19 devstack sudo[103635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:19 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:01:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] Flow 'volume_create_manager' (f15a1706-3c6c-472b-bee0-2a9c4b4dac6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa3390e-9c75-4742-a594-d267ee71dda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa3390e-9c75-4742-a594-d267ee71dda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1165207985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78c2033-aa1d-417e-99ac-3a4ed70d328c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6007c1acaba24912932a52f0c79a4cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:20Z,use_quota=True,user_id='18639c4bf7c4420d99302b2b7206daf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13e73e9b-d030-4fea-8bbb-e4a500fe774e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13e73e9b-d030-4fea-8bbb-e4a500fe774e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf26fe8c-3c6b-4ec0-9a36-bf0b32d0fc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf26fe8c-3c6b-4ec0-9a36-bf0b32d0fc0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd78c2033-aa1d-417e-99ac-3a4ed70d328c', 'volume_name': 'volume-d78c2033-aa1d-417e-99ac-3a4ed70d328c', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c2de60-149f-4496-8bdb-752b09b03296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c2de60-149f-4496-8bdb-752b09b03296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:19 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b15224c-9299-460f-9bb9-bd79c46272c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:19 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] Volume d78c2033-aa1d-417e-99ac-3a4ed70d328c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d78c2033-aa1d-417e-99ac-3a4ed70d328c', 'volume_size': 1}
Nov 05 10:01:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:20 devstack sudo[103635]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c 1073741824" returned: 0 in 0.555s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:20 devstack sudo[103643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c
Nov 05 10:01:20 devstack sudo[103643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:20 devstack sudo[103643]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c" returned: 0 in 0.294s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:01:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.722s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1165207985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78c2033-aa1d-417e-99ac-3a4ed70d328c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6007c1acaba24912932a52f0c79a4cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:20Z,use_quota=True,user_id='18639c4bf7c4420d99302b2b7206daf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:01:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] Creating volume d78c2033-aa1d-417e-99ac-3a4ed70d328c {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:01:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:01:20 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:01:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d78c2033-aa1d-417e-99ac-3a4ed70d328c 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a61b41f6-1696-46a2-a30d-d7866fb45862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a28508e-a766-486c-a1a4-6492b6c1a05c', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f21a5ba-5bb8-43bf-9402-71837d0a8034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:20 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] Volume volume-1a28508e-a766-486c-a1a4-6492b6c1a05c (1a28508e-a766-486c-a1a4-6492b6c1a05c): created successfully
Nov 05 10:01:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f21a5ba-5bb8-43bf-9402-71837d0a8034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:20 devstack sudo[103648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d78c2033-aa1d-417e-99ac-3a4ed70d328c 1073741824
Nov 05 10:01:20 devstack sudo[103648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] Flow 'volume_create_manager' (538b767b-0a0c-4646-acfe-c09dd4ea6db5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:20 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-9216e362-5199-4924-ae21-c79e833e739f tempest-CreateVolumesFromSnapshotTest-745460845 None] Created volume successfully.
Nov 05 10:01:20 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:01:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Flow 'volume_create_manager' (9c28d753-2849-4fb5-a8fc-8ba0d384aee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a2736c-5d64-443f-a8af-32b8e0474110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a2736c-5d64-443f-a8af-32b8e0474110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-364334856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d658e23-bc7a-4275-8c26-f1022995dda0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3a26c337be4d6db39a9da228a97d9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:21Z,use_quota=True,user_id='a05599b10dc54692a1a6bd8304396278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca3a30d-80c5-4dc1-927b-fc3abba9fc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca3a30d-80c5-4dc1-927b-fc3abba9fc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5b14ad2-2e76-46cf-a3f4-e04ba345a80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5b14ad2-2e76-46cf-a3f4-e04ba345a80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d658e23-bc7a-4275-8c26-f1022995dda0', 'volume_name': 'volume-6d658e23-bc7a-4275-8c26-f1022995dda0', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09bde7c4-8323-4258-a584-324910226243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09bde7c4-8323-4258-a584-324910226243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5830cb70-2a5c-4587-997d-9a6b3199f016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:21 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Volume 6d658e23-bc7a-4275-8c26-f1022995dda0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d658e23-bc7a-4275-8c26-f1022995dda0', 'volume_size': 1}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] Flow 'volume_create_manager' (67a1939b-041f-41b3-a0fa-e9e32245d6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eadcdfd9-b126-4c96-a800-06e1afcc2db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eadcdfd9-b126-4c96-a800-06e1afcc2db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-698336456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c261d4-0c02-4450-a45d-f710951eaaa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6007c1acaba24912932a52f0c79a4cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:21Z,use_quota=True,user_id='18639c4bf7c4420d99302b2b7206daf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55751f0b-5e43-47c1-9353-9f3e69a7a530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55751f0b-5e43-47c1-9353-9f3e69a7a530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (913f8f74-2654-44c4-8ef2-d278e9b680a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (913f8f74-2654-44c4-8ef2-d278e9b680a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53c261d4-0c02-4450-a45d-f710951eaaa5', 'volume_name': 'volume-53c261d4-0c02-4450-a45d-f710951eaaa5', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ca3838-0232-4cea-8ead-8898c6319f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ca3838-0232-4cea-8ead-8898c6319f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00045292-70b3-44ae-8893-d6a2d5e8abae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:21 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] Volume 53c261d4-0c02-4450-a45d-f710951eaaa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53c261d4-0c02-4450-a45d-f710951eaaa5', 'volume_size': 1}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:21 devstack sudo[103648]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d78c2033-aa1d-417e-99ac-3a4ed70d328c 1073741824" returned: 0 in 0.841s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] Flow 'volume_create_manager' (80ee7562-726a-49e1-894a-f252873fded7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ee55ed-489b-428c-a9df-e17f3e1dde3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d78c2033-aa1d-417e-99ac-3a4ed70d328c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ee55ed-489b-428c-a9df-e17f3e1dde3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-290702990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecfc693e-2b3e-4c57-b5f3-d740cd533dfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6007c1acaba24912932a52f0c79a4cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:21Z,use_quota=True,user_id='18639c4bf7c4420d99302b2b7206daf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0675a04b-d9cd-422a-b77b-b19c50be51f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:21 devstack sudo[103655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d78c2033-aa1d-417e-99ac-3a4ed70d328c
Nov 05 10:01:21 devstack sudo[103655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0675a04b-d9cd-422a-b77b-b19c50be51f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b9826e-33f6-4fde-83ae-1e4d83ac6186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b9826e-33f6-4fde-83ae-1e4d83ac6186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecfc693e-2b3e-4c57-b5f3-d740cd533dfb', 'volume_name': 'volume-ecfc693e-2b3e-4c57-b5f3-d740cd533dfb', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85985b61-1f8d-41c5-aba4-4cce1e42e025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85985b61-1f8d-41c5-aba4-4cce1e42e025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2667cdc8-1a71-4494-9eb4-50fdf4f3003f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:21 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] Volume ecfc693e-2b3e-4c57-b5f3-d740cd533dfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecfc693e-2b3e-4c57-b5f3-d740cd533dfb', 'volume_size': 1}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] Flow 'volume_create_manager' (ea267845-befd-4acf-a8e7-467b976e0091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f17a4a2-039e-4543-96c7-c5aaef22483b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-82b53af5-289a-4d74-97b6-2e85c7c9fd82 tempest-CreateVolumesFromSnapshotTest-745460845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f17a4a2-039e-4543-96c7-c5aaef22483b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-314132547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4a7e2f8-6ea9-401c-9da0-7629006c0c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6007c1acaba24912932a52f0c79a4cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:22Z,use_quota=True,user_id='18639c4bf7c4420d99302b2b7206daf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d91f90e-476b-4ead-ad4e-fcccd925b85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d91f90e-476b-4ead-ad4e-fcccd925b85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc174356-9a2d-44ac-a428-f527af8ee44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc174356-9a2d-44ac-a428-f527af8ee44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4a7e2f8-6ea9-401c-9da0-7629006c0c24', 'volume_name': 'volume-b4a7e2f8-6ea9-401c-9da0-7629006c0c24', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e72897df-8cb5-41b2-970e-3a46be636eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e72897df-8cb5-41b2-970e-3a46be636eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e529449-d89a-497d-9bbe-d4a2bbc0bc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:21 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] Volume b4a7e2f8-6ea9-401c-9da0-7629006c0c24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4a7e2f8-6ea9-401c-9da0-7629006c0c24', 'volume_size': 1}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] Flow 'volume_create_manager' (1f407d60-edba-4128-b2a1-fb44803c32f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ada6e5f-09a6-4c69-9ad7-8081947ece31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ada6e5f-09a6-4c69-9ad7-8081947ece31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-290852642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff91c6c-0639-4491-abb6-7e10fe57f79f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6007c1acaba24912932a52f0c79a4cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:22Z,use_quota=True,user_id='18639c4bf7c4420d99302b2b7206daf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e7de59-3a96-42df-936d-a1eb5e644749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:21 devstack sudo[103655]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e7de59-3a96-42df-936d-a1eb5e644749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (281ba9dc-508a-4538-ac9e-f7bb0a473d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (281ba9dc-508a-4538-ac9e-f7bb0a473d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ff91c6c-0639-4491-abb6-7e10fe57f79f', 'volume_name': 'volume-7ff91c6c-0639-4491-abb6-7e10fe57f79f', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3400d5ce-6d6d-471c-bed5-86ccbc53edec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3400d5ce-6d6d-471c-bed5-86ccbc53edec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e4f0e2c-a1c4-4d37-b60e-193bf3001b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:21 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] Volume 7ff91c6c-0639-4491-abb6-7e10fe57f79f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ff91c6c-0639-4491-abb6-7e10fe57f79f', 'volume_size': 1}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d78c2033-aa1d-417e-99ac-3a4ed70d328c" returned: 0 in 0.481s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] <== create_volume: return (1449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.893s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-364334856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d658e23-bc7a-4275-8c26-f1022995dda0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3a26c337be4d6db39a9da228a97d9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:21Z,use_quota=True,user_id='a05599b10dc54692a1a6bd8304396278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Creating volume 6d658e23-bc7a-4275-8c26-f1022995dda0 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:01:21 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6d658e23-bc7a-4275-8c26-f1022995dda0 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b15224c-9299-460f-9bb9-bd79c46272c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d78c2033-aa1d-417e-99ac-3a4ed70d328c', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:21 devstack sudo[103658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6d658e23-bc7a-4275-8c26-f1022995dda0 1073741824
Nov 05 10:01:21 devstack sudo[103658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4524a41d-4b4d-4188-942c-12afa247ee4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:21 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] Volume volume-d78c2033-aa1d-417e-99ac-3a4ed70d328c (d78c2033-aa1d-417e-99ac-3a4ed70d328c): created successfully
Nov 05 10:01:21 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4524a41d-4b4d-4188-942c-12afa247ee4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] Flow 'volume_create_manager' (f15a1706-3c6c-472b-bee0-2a9c4b4dac6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:22 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-77e89c95-6986-4ada-963e-8e29cf09c12c tempest-CreateVolumesFromImageTest-1272619157 None] Created volume successfully.
Nov 05 10:01:22 devstack sudo[103658]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6d658e23-bc7a-4275-8c26-f1022995dda0 1073741824" returned: 0 in 0.477s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6d658e23-bc7a-4275-8c26-f1022995dda0 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:22 devstack sudo[103664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6d658e23-bc7a-4275-8c26-f1022995dda0
Nov 05 10:01:22 devstack sudo[103664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:22 devstack sudo[103664]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6d658e23-bc7a-4275-8c26-f1022995dda0" returned: 0 in 0.269s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:01:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.491s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-698336456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c261d4-0c02-4450-a45d-f710951eaaa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6007c1acaba24912932a52f0c79a4cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:21Z,use_quota=True,user_id='18639c4bf7c4420d99302b2b7206daf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:01:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] Creating volume 53c261d4-0c02-4450-a45d-f710951eaaa5 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:01:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:01:22 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:01:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-53c261d4-0c02-4450-a45d-f710951eaaa5 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5830cb70-2a5c-4587-997d-9a6b3199f016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d658e23-bc7a-4275-8c26-f1022995dda0', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:22 devstack sudo[103667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-53c261d4-0c02-4450-a45d-f710951eaaa5 1073741824
Nov 05 10:01:22 devstack sudo[103667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd3499e-600d-4050-8be7-4db797b735f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:22 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Volume volume-6d658e23-bc7a-4275-8c26-f1022995dda0 (6d658e23-bc7a-4275-8c26-f1022995dda0): created successfully
Nov 05 10:01:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd3499e-600d-4050-8be7-4db797b735f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Flow 'volume_create_manager' (9c28d753-2849-4fb5-a8fc-8ba0d384aee6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:22 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-dc6fe6a3-4d55-416d-9aed-c23d364f9b6d tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Created volume successfully.
Nov 05 10:01:23 devstack sudo[103667]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-53c261d4-0c02-4450-a45d-f710951eaaa5 1073741824" returned: 0 in 0.474s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-53c261d4-0c02-4450-a45d-f710951eaaa5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:23 devstack sudo[103673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-53c261d4-0c02-4450-a45d-f710951eaaa5
Nov 05 10:01:23 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:23 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-53c261d4-0c02-4450-a45d-f710951eaaa5" returned: 0 in 0.252s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:01:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.964s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-290702990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecfc693e-2b3e-4c57-b5f3-d740cd533dfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6007c1acaba24912932a52f0c79a4cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:21Z,use_quota=True,user_id='18639c4bf7c4420d99302b2b7206daf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:01:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] Creating volume ecfc693e-2b3e-4c57-b5f3-d740cd533dfb {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:01:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:01:23 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:01:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ecfc693e-2b3e-4c57-b5f3-d740cd533dfb 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:23 devstack sudo[103676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ecfc693e-2b3e-4c57-b5f3-d740cd533dfb 1073741824
Nov 05 10:01:23 devstack sudo[103676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00045292-70b3-44ae-8893-d6a2d5e8abae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53c261d4-0c02-4450-a45d-f710951eaaa5', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2981ef77-c506-47ae-83e2-fcbd764564e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:23 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] Volume volume-53c261d4-0c02-4450-a45d-f710951eaaa5 (53c261d4-0c02-4450-a45d-f710951eaaa5): created successfully
Nov 05 10:01:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2981ef77-c506-47ae-83e2-fcbd764564e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] Flow 'volume_create_manager' (67a1939b-041f-41b3-a0fa-e9e32245d6fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:23 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b7ff7ebc-57ad-47c3-b43c-db6bc8abbc07 tempest-CreateVolumesFromImageTest-1272619157 None] Created volume successfully.
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:01:24 devstack sudo[103676]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Flow 'volume_create_manager' (9c17cbf1-cfbb-4d82-aa94-288ac3694e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29e13c64-8bdb-40fe-98cb-306cd0724923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ecfc693e-2b3e-4c57-b5f3-d740cd533dfb 1073741824" returned: 0 in 0.675s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29e13c64-8bdb-40fe-98cb-306cd0724923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-954532784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9847046-ae39-4fd1-a26f-c26d86f89142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3a26c337be4d6db39a9da228a97d9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:24Z,use_quota=True,user_id='a05599b10dc54692a1a6bd8304396278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0de789b1-3ddc-4cfa-89a1-bab4d78cc646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0de789b1-3ddc-4cfa-89a1-bab4d78cc646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d081e51-5e24-4acd-8d7d-a2deddeefec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d081e51-5e24-4acd-8d7d-a2deddeefec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9847046-ae39-4fd1-a26f-c26d86f89142', 'volume_name': 'volume-c9847046-ae39-4fd1-a26f-c26d86f89142', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b32dda6-feef-40e5-b0b1-860f0a5c6d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b32dda6-feef-40e5-b0b1-860f0a5c6d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81ce0cc8-c58e-4c65-910f-34235a3e5c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:24 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Volume c9847046-ae39-4fd1-a26f-c26d86f89142: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9847046-ae39-4fd1-a26f-c26d86f89142', 'volume_size': 1}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ecfc693e-2b3e-4c57-b5f3-d740cd533dfb {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:01:24 devstack sudo[103682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ecfc693e-2b3e-4c57-b5f3-d740cd533dfb
Nov 05 10:01:24 devstack sudo[103682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Flow 'volume_create_manager' (bad4aca3-abed-492f-a008-ccd181a6b1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90e89fcf-b99a-44d5-905f-fd96a0d42c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90e89fcf-b99a-44d5-905f-fd96a0d42c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3dc203e-63b4-4d92-8bbb-0758c6a54d42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e3110ab3add4862b527219163a70a03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:24Z,use_quota=True,user_id='08ef20a52868468baf72417e693cbb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed6b848d-b6f3-4b4b-8c77-d1db767f5b53),volume_type_id=ed6b848d-b6f3-4b4b-8c77-d1db767f5b53)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b4768c-e80c-48c7-9e86-acc4518e4300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b4768c-e80c-48c7-9e86-acc4518e4300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f865f02-1a0a-41c7-b6eb-5fccdf3475b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.image.glance [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Creating Keystone auth plugin from conf {{(pid=86649) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Flow 'volume_create_manager' (16613226-0050-4943-9406-efbacf417b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:24 devstack sudo[103682]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b886428a-31e3-45c4-92aa-e0a1e7256dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ecfc693e-2b3e-4c57-b5f3-d740cd533dfb" returned: 0 in 0.381s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-82b53af5-289a-4d74-97b6-2e85c7c9fd82 tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.080s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b886428a-31e3-45c4-92aa-e0a1e7256dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-925085843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c93a9b94-8fcf-414f-a74a-605752e9a3ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3a26c337be4d6db39a9da228a97d9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:25Z,use_quota=True,user_id='a05599b10dc54692a1a6bd8304396278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (771bec3c-6c78-44c6-a2f1-05988667b2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (771bec3c-6c78-44c6-a2f1-05988667b2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56a4eafe-5790-4817-8f25-6679cfe104bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56a4eafe-5790-4817-8f25-6679cfe104bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c93a9b94-8fcf-414f-a74a-605752e9a3ce', 'volume_name': 'volume-c93a9b94-8fcf-414f-a74a-605752e9a3ce', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f00dce8a-7c80-4e5e-82d5-46e717044214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f00dce8a-7c80-4e5e-82d5-46e717044214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (badaa1c8-6dee-4541-8b1c-d0850ac5dfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:24 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Volume c93a9b94-8fcf-414f-a74a-605752e9a3ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c93a9b94-8fcf-414f-a74a-605752e9a3ce', 'volume_size': 1}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2667cdc8-1a71-4494-9eb4-50fdf4f3003f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecfc693e-2b3e-4c57-b5f3-d740cd533dfb', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e745c93f-a09a-48a1-a354-e79ef7b16589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-82b53af5-289a-4d74-97b6-2e85c7c9fd82 tempest-CreateVolumesFromSnapshotTest-745460845 None] Creating offline snapshot e854dc33-a81a-4e4e-a5c5-82bb689ef163 of volume 1a28508e-a766-486c-a1a4-6492b6c1a05c {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f865f02-1a0a-41c7-b6eb-5fccdf3475b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a3dc203e-63b4-4d92-8bbb-0758c6a54d42', 'volume_name': 'volume-a3dc203e-63b4-4d92-8bbb-0758c6a54d42', 'volume_size': 1, 'image_id': 'fdc9bb51-fb4c-48b3-b6c7-80ceb0026333', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fdc9bb51-fb4c-48b3-b6c7-80ceb0026333', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '97c18e7d669702b7fba0bf8113e75045', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9e3110ab3add4862b527219163a70a03', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '130e01ada31f04bffc29628d268625531690b69679ff1a7a90e67cafc56daf42a8ea96163e099b2a94cbfb67a24b4e6121e3fe623ef54c09648471465c748f02', 'id': 'fdc9bb51-fb4c-48b3-b6c7-80ceb0026333', 'created_at': datetime.datetime(2026, 11, 5, 9, 1, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 9, 1, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fdc9bb51-fb4c-48b3-b6c7-80ceb0026333/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78419c2d1310>}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c18657e5-db06-46aa-ac98-5d8fe05900d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c18657e5-db06-46aa-ac98-5d8fe05900d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab3f9174-5012-4a21-a369-90944f68be40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:24 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Volume a3dc203e-63b4-4d92-8bbb-0758c6a54d42: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a3dc203e-63b4-4d92-8bbb-0758c6a54d42', 'volume_size': 1, 'image_id': 'fdc9bb51-fb4c-48b3-b6c7-80ceb0026333', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fdc9bb51-fb4c-48b3-b6c7-80ceb0026333', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '97c18e7d669702b7fba0bf8113e75045', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9e3110ab3add4862b527219163a70a03', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '130e01ada31f04bffc29628d268625531690b69679ff1a7a90e67cafc56daf42a8ea96163e099b2a94cbfb67a24b4e6121e3fe623ef54c09648471465c748f02', 'id': 'fdc9bb51-fb4c-48b3-b6c7-80ceb0026333', 'created_at': datetime.datetime(2026, 11, 5, 9, 1, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 9, 1, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fdc9bb51-fb4c-48b3-b6c7-80ceb0026333/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78419c2d1310>}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Trying to clone a3dc203e-63b4-4d92-8bbb-0758c6a54d42 from image fdc9bb51-fb4c-48b3-b6c7-80ceb0026333 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fdc9bb51-fb4c-48b3-b6c7-80ceb0026333', 'metadata': {}}]). {{(pid=86649) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7aaa1b-6ce6-4f29-816a-b50b6e469ea8]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-82b53af5-289a-4d74-97b6-2e85c7c9fd82 tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:24 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] Volume volume-ecfc693e-2b3e-4c57-b5f3-d740cd533dfb (ecfc693e-2b3e-4c57-b5f3-d740cd533dfb): created successfully
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e745c93f-a09a-48a1-a354-e79ef7b16589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] Flow 'volume_create_manager' (80ee7562-726a-49e1-894a-f252873fded7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:24 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-24f33f46-b8fc-4ace-8b44-5eb176a427ef tempest-CreateVolumesFromImageTest-1272619157 None] Created volume successfully.
Nov 05 10:01:24 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fdc9bb51-fb4c-48b3-b6c7-80ceb0026333_zkjtppobdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 10:01:24 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 10:01:24 devstack sudo[103685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c
Nov 05 10:01:24 devstack sudo[103685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[218813f8-c81a-4c63-ac68-4f53863f38d4]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdc9bb51-fb4c-48b3-b6c7-80ceb0026333_zkjtppobdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Flow 'volume_create_manager' (45d2f007-bbb3-4be3-b03d-451b210bd45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a328d37-177d-404a-9c91-49059e890e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:25 devstack sudo[103688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdc9bb51-fb4c-48b3-b6c7-80ceb0026333_zkjtppobdevstack@QuobyteHD
Nov 05 10:01:25 devstack sudo[103688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a328d37-177d-404a-9c91-49059e890e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1257161014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=343a3daf-3808-49bf-8236-b707afae381b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3a26c337be4d6db39a9da228a97d9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:25Z,use_quota=True,user_id='a05599b10dc54692a1a6bd8304396278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a408928f-50c2-48ad-83f2-bbbac8ecc9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a408928f-50c2-48ad-83f2-bbbac8ecc9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d2c7ba6-5c42-4923-b7ef-5462ff19c2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d2c7ba6-5c42-4923-b7ef-5462ff19c2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '343a3daf-3808-49bf-8236-b707afae381b', 'volume_name': 'volume-343a3daf-3808-49bf-8236-b707afae381b', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb34bea-b240-48db-af2a-a4e43af20658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb34bea-b240-48db-af2a-a4e43af20658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (341d74fb-521e-4090-b650-4789a0d5c9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:25 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Volume 343a3daf-3808-49bf-8236-b707afae381b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-343a3daf-3808-49bf-8236-b707afae381b', 'volume_size': 1}
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:25 devstack sudo[103685]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-82b53af5-289a-4d74-97b6-2e85c7c9fd82 tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c" returned: 0 in 0.587s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-82b53af5-289a-4d74-97b6-2e85c7c9fd82 tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c.e854dc33-a81a-4e4e-a5c5-82bb689ef163 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:25 devstack sudo[103693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c.e854dc33-a81a-4e4e-a5c5-82bb689ef163 1G
Nov 05 10:01:25 devstack sudo[103693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:25 devstack sudo[103688]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdc9bb51-fb4c-48b3-b6c7-80ceb0026333_zkjtppobdevstack@QuobyteHD" returned: 0 in 0.487s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdc9bb51-fb4c-48b3-b6c7-80ceb0026333_zkjtppobdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Flow 'volume_create_manager' (0895fd8d-8bb5-4746-a34c-63f66b8f7203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1925fc73-c4dd-4f64-9df1-bc9487175a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1925fc73-c4dd-4f64-9df1-bc9487175a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1671483947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d411f920-45d6-4eca-9684-725fe9c8ce24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3a26c337be4d6db39a9da228a97d9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:25Z,use_quota=True,user_id='a05599b10dc54692a1a6bd8304396278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1555f819-d189-4a64-a32c-ffb0dcd594d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1555f819-d189-4a64-a32c-ffb0dcd594d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1679b2-374e-4402-b91b-61ffdbcf60c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1679b2-374e-4402-b91b-61ffdbcf60c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd411f920-45d6-4eca-9684-725fe9c8ce24', 'volume_name': 'volume-d411f920-45d6-4eca-9684-725fe9c8ce24', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca36cb60-1f42-416d-a2e7-9c7bf7c63827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca36cb60-1f42-416d-a2e7-9c7bf7c63827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7517313-df21-41d9-820f-18ddd3654a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:25 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Volume d411f920-45d6-4eca-9684-725fe9c8ce24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d411f920-45d6-4eca-9684-725fe9c8ce24', 'volume_size': 1}
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:25 devstack sudo[103697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdc9bb51-fb4c-48b3-b6c7-80ceb0026333_zkjtppobdevstack@QuobyteHD
Nov 05 10:01:25 devstack sudo[103697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:25 devstack sudo[103693]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-82b53af5-289a-4d74-97b6-2e85c7c9fd82 tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c.e854dc33-a81a-4e4e-a5c5-82bb689ef163 1G" returned: 0 in 0.516s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-82b53af5-289a-4d74-97b6-2e85c7c9fd82 tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a28508e-a766-486c-a1a4-6492b6c1a05c -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c.e854dc33-a81a-4e4e-a5c5-82bb689ef163 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:25 devstack sudo[103697]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdc9bb51-fb4c-48b3-b6c7-80ceb0026333_zkjtppobdevstack@QuobyteHD" returned: 1 in 0.461s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdc9bb51-fb4c-48b3-b6c7-80ceb0026333_zkjtppobdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 10:01:25 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Temporary image fdc9bb51-fb4c-48b3-b6c7-80ceb0026333 is fetched for user 08ef20a52868468baf72417e693cbb90. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 10:01:25 devstack sudo[103706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a28508e-a766-486c-a1a4-6492b6c1a05c -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c.e854dc33-a81a-4e4e-a5c5-82bb689ef163
Nov 05 10:01:25 devstack sudo[103706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:26 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:01:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Flow 'volume_create_manager' (d843a141-0623-4a29-bf0c-2110cff74f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34cb1d07-6608-4a60-8b7f-67d019eb3a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34cb1d07-6608-4a60-8b7f-67d019eb3a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-565819307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7816517-9926-4a64-951f-3d9aace52fbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3a26c337be4d6db39a9da228a97d9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:26Z,use_quota=True,user_id='a05599b10dc54692a1a6bd8304396278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7857ddcb-1803-429c-bbde-ad625ec10495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7857ddcb-1803-429c-bbde-ad625ec10495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857b2d5c-beb9-4b92-912b-d093c662ac28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857b2d5c-beb9-4b92-912b-d093c662ac28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7816517-9926-4a64-951f-3d9aace52fbb', 'volume_name': 'volume-f7816517-9926-4a64-951f-3d9aace52fbb', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0281265-efc5-4cc3-b3a6-d941d131ca7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0281265-efc5-4cc3-b3a6-d941d131ca7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef3130be-c150-4a60-8caa-ac52c4e78e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:26 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Volume f7816517-9926-4a64-951f-3d9aace52fbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7816517-9926-4a64-951f-3d9aace52fbb', 'volume_size': 1}
Nov 05 10:01:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:26 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1829f08-3adb-40e8-8e25-924d526abd58]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:01:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdc9bb51-fb4c-48b3-b6c7-80ceb0026333_zkjtppobdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:26 devstack sudo[103706]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:26 devstack sudo[103708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdc9bb51-fb4c-48b3-b6c7-80ceb0026333_zkjtppobdevstack@QuobyteHD
Nov 05 10:01:26 devstack sudo[103708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-82b53af5-289a-4d74-97b6-2e85c7c9fd82 tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a28508e-a766-486c-a1a4-6492b6c1a05c -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c.e854dc33-a81a-4e4e-a5c5-82bb689ef163" returned: 0 in 0.306s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:26 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-82b53af5-289a-4d74-97b6-2e85c7c9fd82 tempest-CreateVolumesFromSnapshotTest-745460845 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c.e854dc33-a81a-4e4e-a5c5-82bb689ef163 is being set with open permissions: ugo+rw
Nov 05 10:01:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-82b53af5-289a-4d74-97b6-2e85c7c9fd82 tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c.e854dc33-a81a-4e4e-a5c5-82bb689ef163 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:26 devstack sudo[103713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c.e854dc33-a81a-4e4e-a5c5-82bb689ef163
Nov 05 10:01:26 devstack sudo[103713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:26 devstack sudo[103708]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdc9bb51-fb4c-48b3-b6c7-80ceb0026333_zkjtppobdevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdc9bb51-fb4c-48b3-b6c7-80ceb0026333_zkjtppobdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:26 devstack sudo[103713]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-82b53af5-289a-4d74-97b6-2e85c7c9fd82 tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c.e854dc33-a81a-4e4e-a5c5-82bb689ef163" returned: 0 in 0.279s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-82b53af5-289a-4d74-97b6-2e85c7c9fd82 tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:26 devstack sudo[103717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdc9bb51-fb4c-48b3-b6c7-80ceb0026333_zkjtppobdevstack@QuobyteHD
Nov 05 10:01:26 devstack sudo[103717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:26 devstack sudo[103719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c.info
Nov 05 10:01:26 devstack sudo[103719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:26 devstack sudo[103717]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdc9bb51-fb4c-48b3-b6c7-80ceb0026333_zkjtppobdevstack@QuobyteHD" returned: 1 in 0.356s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdc9bb51-fb4c-48b3-b6c7-80ceb0026333_zkjtppobdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 10:01:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:26 devstack sudo[103719]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-82b53af5-289a-4d74-97b6-2e85c7c9fd82 tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c.info" returned: 0 in 0.287s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:26 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-82b53af5-289a-4d74-97b6-2e85c7c9fd82 tempest-CreateVolumesFromSnapshotTest-745460845 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c.info is being set with open permissions: ugo+rw
Nov 05 10:01:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-82b53af5-289a-4d74-97b6-2e85c7c9fd82 tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:26 devstack sudo[103726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c.info
Nov 05 10:01:26 devstack sudo[103726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:27 devstack sudo[103726]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-82b53af5-289a-4d74-97b6-2e85c7c9fd82 tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c.info" returned: 0 in 0.245s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-82b53af5-289a-4d74-97b6-2e85c7c9fd82 tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.398s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.392s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-314132547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4a7e2f8-6ea9-401c-9da0-7629006c0c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6007c1acaba24912932a52f0c79a4cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:22Z,use_quota=True,user_id='18639c4bf7c4420d99302b2b7206daf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:01:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] Creating volume b4a7e2f8-6ea9-401c-9da0-7629006c0c24 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:01:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:01:27 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:01:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b4a7e2f8-6ea9-401c-9da0-7629006c0c24 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:27 devstack sudo[103729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b4a7e2f8-6ea9-401c-9da0-7629006c0c24 1073741824
Nov 05 10:01:27 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:27 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-82b53af5-289a-4d74-97b6-2e85c7c9fd82 tempest-CreateVolumesFromSnapshotTest-745460845 None] Create snapshot completed successfully
Nov 05 10:01:27 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b4a7e2f8-6ea9-401c-9da0-7629006c0c24 1073741824" returned: 0 in 0.454s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b4a7e2f8-6ea9-401c-9da0-7629006c0c24 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:27 devstack sudo[103735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b4a7e2f8-6ea9-401c-9da0-7629006c0c24
Nov 05 10:01:27 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:27 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b4a7e2f8-6ea9-401c-9da0-7629006c0c24" returned: 0 in 0.269s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:01:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.971s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-290852642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff91c6c-0639-4491-abb6-7e10fe57f79f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6007c1acaba24912932a52f0c79a4cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:22Z,use_quota=True,user_id='18639c4bf7c4420d99302b2b7206daf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:01:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] Creating volume 7ff91c6c-0639-4491-abb6-7e10fe57f79f {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:01:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:01:27 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:01:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7ff91c6c-0639-4491-abb6-7e10fe57f79f 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e529449-d89a-497d-9bbe-d4a2bbc0bc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4a7e2f8-6ea9-401c-9da0-7629006c0c24', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aaec382-ac43-4307-92a1-0eea8e4c3433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:27 devstack sudo[103740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7ff91c6c-0639-4491-abb6-7e10fe57f79f 1073741824
Nov 05 10:01:27 devstack sudo[103740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:27 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] Volume volume-b4a7e2f8-6ea9-401c-9da0-7629006c0c24 (b4a7e2f8-6ea9-401c-9da0-7629006c0c24): created successfully
Nov 05 10:01:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aaec382-ac43-4307-92a1-0eea8e4c3433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] Flow 'volume_create_manager' (ea267845-befd-4acf-a8e7-467b976e0091) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:28 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-718eb830-6e16-4bf0-8378-08b6656ae214 tempest-CreateVolumesFromImageTest-1272619157 None] Created volume successfully.
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] Flow 'volume_create_manager' (9d565f75-7283-4780-bcf4-66b29634d49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99e44587-435e-4101-b521-01426dac73b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99e44587-435e-4101-b521-01426dac73b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1032083001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28aa6776-fbb7-4e65-a3e0-0cb6ebead596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='818eba8a7d7044d99f976244633bd2e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:28Z,use_quota=True,user_id='6728f8d617f240b0a33dfb9758764bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (963a2aba-8af4-41d2-aac9-b5e98c427a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (963a2aba-8af4-41d2-aac9-b5e98c427a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e8ddfd-8fb3-49f7-b0a9-2e91e3120827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e8ddfd-8fb3-49f7-b0a9-2e91e3120827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28aa6776-fbb7-4e65-a3e0-0cb6ebead596', 'volume_name': 'volume-28aa6776-fbb7-4e65-a3e0-0cb6ebead596', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02c41de7-2022-458e-8364-78482de6a9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02c41de7-2022-458e-8364-78482de6a9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c1655dd-7279-4ffd-881d-a10dfdd97d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:28 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] Volume 28aa6776-fbb7-4e65-a3e0-0cb6ebead596: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28aa6776-fbb7-4e65-a3e0-0cb6ebead596', 'volume_size': 1}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:28 devstack sudo[103740]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7ff91c6c-0639-4491-abb6-7e10fe57f79f 1073741824" returned: 0 in 0.510s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7ff91c6c-0639-4491-abb6-7e10fe57f79f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:28 devstack sudo[103746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7ff91c6c-0639-4491-abb6-7e10fe57f79f
Nov 05 10:01:28 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] Flow 'volume_create_manager' (f40bb3c7-64e3-4398-9101-3a1988cf6c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12e93f87-bb1a-43e1-8ac5-5e4dd4a7043d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12e93f87-bb1a-43e1-8ac5-5e4dd4a7043d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1905997799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d2ff95-0329-469c-be78-0e4362ae7c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='818eba8a7d7044d99f976244633bd2e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:28Z,use_quota=True,user_id='6728f8d617f240b0a33dfb9758764bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04f67a69-a380-4065-bba8-9071610bf652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04f67a69-a380-4065-bba8-9071610bf652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58312088-2c72-4db0-91ca-5c70ac24c684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58312088-2c72-4db0-91ca-5c70ac24c684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4d2ff95-0329-469c-be78-0e4362ae7c25', 'volume_name': 'volume-c4d2ff95-0329-469c-be78-0e4362ae7c25', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c280422-3be4-4dda-9561-15f2980035ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c280422-3be4-4dda-9561-15f2980035ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08c8929-d3ca-44ee-9ce1-beeaa848b7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:28 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] Volume c4d2ff95-0329-469c-be78-0e4362ae7c25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4d2ff95-0329-469c-be78-0e4362ae7c25', 'volume_size': 1}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:28 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7ff91c6c-0639-4491-abb6-7e10fe57f79f" returned: 0 in 0.311s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.487s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-954532784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9847046-ae39-4fd1-a26f-c26d86f89142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3a26c337be4d6db39a9da228a97d9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:24Z,use_quota=True,user_id='a05599b10dc54692a1a6bd8304396278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Creating volume c9847046-ae39-4fd1-a26f-c26d86f89142 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:01:28 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c9847046-ae39-4fd1-a26f-c26d86f89142 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e4f0e2c-a1c4-4d37-b60e-193bf3001b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ff91c6c-0639-4491-abb6-7e10fe57f79f', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:28 devstack sudo[103749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c9847046-ae39-4fd1-a26f-c26d86f89142 1073741824
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bb03d92-bae0-4f5f-b208-59ce2691ad26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:28 devstack sudo[103749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:28 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] Volume volume-7ff91c6c-0639-4491-abb6-7e10fe57f79f (7ff91c6c-0639-4491-abb6-7e10fe57f79f): created successfully
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bb03d92-bae0-4f5f-b208-59ce2691ad26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] Flow 'volume_create_manager' (1f407d60-edba-4128-b2a1-fb44803c32f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:28 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c04701c0-4200-4524-bdbe-afc789a09bac tempest-CreateVolumesFromImageTest-1272619157 None] Created volume successfully.
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] Flow 'volume_create_manager' (2c9b572a-d102-4a0b-aca0-9bb361c19548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91fab836-034b-4edf-8c39-7b2c7dffb6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91fab836-034b-4edf-8c39-7b2c7dffb6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1222999438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4f26208-8ea2-4f01-94c7-5ccd44cbac5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='818eba8a7d7044d99f976244633bd2e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:29Z,use_quota=True,user_id='6728f8d617f240b0a33dfb9758764bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0999d300-c5b4-4cd4-bb1f-58d4af6f45cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0999d300-c5b4-4cd4-bb1f-58d4af6f45cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e79e21d6-9e5c-4391-b96e-41c6e0a482f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e79e21d6-9e5c-4391-b96e-41c6e0a482f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4f26208-8ea2-4f01-94c7-5ccd44cbac5f', 'volume_name': 'volume-e4f26208-8ea2-4f01-94c7-5ccd44cbac5f', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6131f7ff-1dc0-4e94-86a6-40ad8567e3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6131f7ff-1dc0-4e94-86a6-40ad8567e3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43c231f5-ad84-44c2-87a3-247870f04113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:29 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] Volume e4f26208-8ea2-4f01-94c7-5ccd44cbac5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4f26208-8ea2-4f01-94c7-5ccd44cbac5f', 'volume_size': 1}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:29 devstack sudo[103749]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c9847046-ae39-4fd1-a26f-c26d86f89142 1073741824" returned: 0 in 0.560s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] Flow 'volume_create_manager' (80be4314-f432-4ce9-9a7d-c252b00cbd5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29d88596-df9e-4e7c-b9d8-dbca68b66b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29d88596-df9e-4e7c-b9d8-dbca68b66b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1950522510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25459d8d-fa31-4e6d-9875-af6120698f59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='818eba8a7d7044d99f976244633bd2e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:29Z,use_quota=True,user_id='6728f8d617f240b0a33dfb9758764bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be5ab13d-2078-4911-8b51-88662af38fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be5ab13d-2078-4911-8b51-88662af38fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb9ece70-22e2-409a-9199-9c2ee24b4d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb9ece70-22e2-409a-9199-9c2ee24b4d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25459d8d-fa31-4e6d-9875-af6120698f59', 'volume_name': 'volume-25459d8d-fa31-4e6d-9875-af6120698f59', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e8f162-07f9-4387-9853-c15a4cd86bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e8f162-07f9-4387-9853-c15a4cd86bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22ba9efc-000a-448b-b95d-d901704bae4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:29 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] Volume 25459d8d-fa31-4e6d-9875-af6120698f59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25459d8d-fa31-4e6d-9875-af6120698f59', 'volume_size': 1}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c9847046-ae39-4fd1-a26f-c26d86f89142 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:29 devstack sudo[103755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c9847046-ae39-4fd1-a26f-c26d86f89142
Nov 05 10:01:29 devstack sudo[103755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:01:29 devstack sudo[103755]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] Flow 'volume_create_manager' (440cef6b-651b-428a-98f6-e11e0becc4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1996efba-18ba-4c51-a5f4-794679f2de5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c9847046-ae39-4fd1-a26f-c26d86f89142" returned: 0 in 0.291s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-925085843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c93a9b94-8fcf-414f-a74a-605752e9a3ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3a26c337be4d6db39a9da228a97d9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:25Z,use_quota=True,user_id='a05599b10dc54692a1a6bd8304396278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Creating volume c93a9b94-8fcf-414f-a74a-605752e9a3ce {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:01:29 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c93a9b94-8fcf-414f-a74a-605752e9a3ce 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1996efba-18ba-4c51-a5f4-794679f2de5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-506882322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d54809-1625-4bd2-a01d-c64d631466c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='818eba8a7d7044d99f976244633bd2e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:30Z,use_quota=True,user_id='6728f8d617f240b0a33dfb9758764bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28da64ee-3f6e-4320-8fbd-c0f1906aef53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28da64ee-3f6e-4320-8fbd-c0f1906aef53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:29 devstack sudo[103759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c93a9b94-8fcf-414f-a74a-605752e9a3ce 1073741824
Nov 05 10:01:29 devstack sudo[103759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (570fe07f-056c-47d1-9712-05aa3fb88e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (570fe07f-056c-47d1-9712-05aa3fb88e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36d54809-1625-4bd2-a01d-c64d631466c1', 'volume_name': 'volume-36d54809-1625-4bd2-a01d-c64d631466c1', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17aca40d-e728-4a16-aa80-96edc54dcba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17aca40d-e728-4a16-aa80-96edc54dcba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee8be8c-ed43-4035-8c24-22c60640afe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:29 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] Volume 36d54809-1625-4bd2-a01d-c64d631466c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36d54809-1625-4bd2-a01d-c64d631466c1', 'volume_size': 1}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81ce0cc8-c58e-4c65-910f-34235a3e5c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9847046-ae39-4fd1-a26f-c26d86f89142', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (248024d2-dce6-4ad4-b2b0-43a439b89511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:29 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Volume volume-c9847046-ae39-4fd1-a26f-c26d86f89142 (c9847046-ae39-4fd1-a26f-c26d86f89142): created successfully
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (248024d2-dce6-4ad4-b2b0-43a439b89511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Flow 'volume_create_manager' (9c17cbf1-cfbb-4d82-aa94-288ac3694e2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1e9c7568-e298-4965-bcc4-926227c23167 tempest-CreateVolumesFromImageTest-1272619157 None] Acquiring lock "cinder-7ff91c6c-0639-4491-abb6-7e10fe57f79f-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:29 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-52e1a4ce-ece4-40b2-b9bb-3a252c36af56 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Created volume successfully.
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1e9c7568-e298-4965-bcc4-926227c23167 tempest-CreateVolumesFromImageTest-1272619157 None] Lock "cinder-7ff91c6c-0639-4491-abb6-7e10fe57f79f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1e9c7568-e298-4965-bcc4-926227c23167 tempest-CreateVolumesFromImageTest-1272619157 None] Acquiring lock "cinder-quobyte-7ff91c6c-0639-4491-abb6-7e10fe57f79f" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1e9c7568-e298-4965-bcc4-926227c23167 tempest-CreateVolumesFromImageTest-1272619157 None] Lock "cinder-quobyte-7ff91c6c-0639-4491-abb6-7e10fe57f79f" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed1941f-2fd5-459c-aa1e-66e9b351aa61]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:01:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1e9c7568-e298-4965-bcc4-926227c23167 tempest-CreateVolumesFromImageTest-1272619157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7ff91c6c-0639-4491-abb6-7e10fe57f79f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:30 devstack sudo[103761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7ff91c6c-0639-4491-abb6-7e10fe57f79f
Nov 05 10:01:30 devstack sudo[103761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:30 devstack sudo[103759]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c93a9b94-8fcf-414f-a74a-605752e9a3ce 1073741824" returned: 0 in 0.508s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c93a9b94-8fcf-414f-a74a-605752e9a3ce {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:30 devstack sudo[103769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c93a9b94-8fcf-414f-a74a-605752e9a3ce
Nov 05 10:01:30 devstack sudo[103769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:30 devstack sudo[103761]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1e9c7568-e298-4965-bcc4-926227c23167 tempest-CreateVolumesFromImageTest-1272619157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7ff91c6c-0639-4491-abb6-7e10fe57f79f" returned: 0 in 0.401s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1e9c7568-e298-4965-bcc4-926227c23167 tempest-CreateVolumesFromImageTest-1272619157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7ff91c6c-0639-4491-abb6-7e10fe57f79f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:30 devstack sudo[103772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7ff91c6c-0639-4491-abb6-7e10fe57f79f
Nov 05 10:01:30 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:30 devstack sudo[103769]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c93a9b94-8fcf-414f-a74a-605752e9a3ce" returned: 0 in 0.255s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:01:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.333s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1257161014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=343a3daf-3808-49bf-8236-b707afae381b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3a26c337be4d6db39a9da228a97d9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:25Z,use_quota=True,user_id='a05599b10dc54692a1a6bd8304396278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:01:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Creating volume 343a3daf-3808-49bf-8236-b707afae381b {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:01:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:01:30 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:01:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-343a3daf-3808-49bf-8236-b707afae381b 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:30 devstack sudo[103776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-343a3daf-3808-49bf-8236-b707afae381b 1073741824
Nov 05 10:01:30 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (badaa1c8-6dee-4541-8b1c-d0850ac5dfb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c93a9b94-8fcf-414f-a74a-605752e9a3ce', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30af0f2f-6b91-4f48-a768-3b49b17ff3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:30 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1e9c7568-e298-4965-bcc4-926227c23167 tempest-CreateVolumesFromImageTest-1272619157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7ff91c6c-0639-4491-abb6-7e10fe57f79f" returned: 0 in 0.291s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:30 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Volume volume-c93a9b94-8fcf-414f-a74a-605752e9a3ce (c93a9b94-8fcf-414f-a74a-605752e9a3ce): created successfully
Nov 05 10:01:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30af0f2f-6b91-4f48-a768-3b49b17ff3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Flow 'volume_create_manager' (16613226-0050-4943-9406-efbacf417b99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1e9c7568-e298-4965-bcc4-926227c23167 tempest-CreateVolumesFromImageTest-1272619157 None] Lock "cinder-quobyte-7ff91c6c-0639-4491-abb6-7e10fe57f79f" released by "delete_volume" :: held 0.758s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:30 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-561905c3-b057-4fa0-a3c7-f10048febafc tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Created volume successfully.
Nov 05 10:01:30 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-1e9c7568-e298-4965-bcc4-926227c23167 tempest-CreateVolumesFromImageTest-1272619157 None] Created reservations ['54839abc-3fef-4bae-a820-07bc7d5312c8', 'bf0e8826-5981-4982-b1c1-5eed8a628a76', 'bbeb5a13-86a1-454f-adde-82de0372a55e', '20337d63-80ee-40a7-9dc4-ab9a6e1d44e0'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:01:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1e9c7568-e298-4965-bcc4-926227c23167 tempest-CreateVolumesFromImageTest-1272619157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1e9c7568-e298-4965-bcc4-926227c23167 tempest-CreateVolumesFromImageTest-1272619157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1e9c7568-e298-4965-bcc4-926227c23167 tempest-CreateVolumesFromImageTest-1272619157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1e9c7568-e298-4965-bcc4-926227c23167 tempest-CreateVolumesFromImageTest-1272619157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1e9c7568-e298-4965-bcc4-926227c23167 tempest-CreateVolumesFromImageTest-1272619157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1e9c7568-e298-4965-bcc4-926227c23167 tempest-CreateVolumesFromImageTest-1272619157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:30 devstack sudo[103780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:01:30 devstack sudo[103780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-608801c4-2eca-49ea-ae60-ea0ce2c9a73f tempest-CreateVolumesFromImageTest-1272619157 None] Acquiring lock "cinder-b4a7e2f8-6ea9-401c-9da0-7629006c0c24-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-608801c4-2eca-49ea-ae60-ea0ce2c9a73f tempest-CreateVolumesFromImageTest-1272619157 None] Lock "cinder-b4a7e2f8-6ea9-401c-9da0-7629006c0c24-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-608801c4-2eca-49ea-ae60-ea0ce2c9a73f tempest-CreateVolumesFromImageTest-1272619157 None] Acquiring lock "cinder-quobyte-b4a7e2f8-6ea9-401c-9da0-7629006c0c24" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:31 devstack sudo[103780]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1e9c7568-e298-4965-bcc4-926227c23167 tempest-CreateVolumesFromImageTest-1272619157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.312s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:31 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-1e9c7568-e298-4965-bcc4-926227c23167 tempest-CreateVolumesFromImageTest-1272619157 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:01:31 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-1e9c7568-e298-4965-bcc4-926227c23167 tempest-CreateVolumesFromImageTest-1272619157 None] Deleted volume successfully.
Nov 05 10:01:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-608801c4-2eca-49ea-ae60-ea0ce2c9a73f tempest-CreateVolumesFromImageTest-1272619157 None] Lock "cinder-quobyte-b4a7e2f8-6ea9-401c-9da0-7629006c0c24" acquired by "delete_volume" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:31 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-343a3daf-3808-49bf-8236-b707afae381b 1073741824" returned: 0 in 0.610s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1e9c7568-e298-4965-bcc4-926227c23167 tempest-CreateVolumesFromImageTest-1272619157 None] Lock "cinder-7ff91c6c-0639-4491-abb6-7e10fe57f79f-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:31 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[3351d3b9-ff26-4ddb-ba12-129bed17af41]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:01:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-608801c4-2eca-49ea-ae60-ea0ce2c9a73f tempest-CreateVolumesFromImageTest-1272619157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b4a7e2f8-6ea9-401c-9da0-7629006c0c24 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-343a3daf-3808-49bf-8236-b707afae381b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:31 devstack sudo[103786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-343a3daf-3808-49bf-8236-b707afae381b
Nov 05 10:01:31 devstack sudo[103786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:31 devstack sudo[103785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b4a7e2f8-6ea9-401c-9da0-7629006c0c24
Nov 05 10:01:31 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:31 devstack sudo[103786]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-343a3daf-3808-49bf-8236-b707afae381b" returned: 0 in 0.278s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:01:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.921s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1671483947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d411f920-45d6-4eca-9684-725fe9c8ce24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3a26c337be4d6db39a9da228a97d9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:25Z,use_quota=True,user_id='a05599b10dc54692a1a6bd8304396278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:01:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Creating volume d411f920-45d6-4eca-9684-725fe9c8ce24 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:01:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:01:31 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:01:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d411f920-45d6-4eca-9684-725fe9c8ce24 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:31 devstack sudo[103790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d411f920-45d6-4eca-9684-725fe9c8ce24 1073741824
Nov 05 10:01:31 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (341d74fb-521e-4090-b650-4789a0d5c9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-343a3daf-3808-49bf-8236-b707afae381b', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f344db1-ddc1-4700-b005-af08aa2db122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:31 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Volume volume-343a3daf-3808-49bf-8236-b707afae381b (343a3daf-3808-49bf-8236-b707afae381b): created successfully
Nov 05 10:01:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f344db1-ddc1-4700-b005-af08aa2db122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Flow 'volume_create_manager' (45d2f007-bbb3-4be3-b03d-451b210bd45b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:31 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-0d6b9816-97de-4868-995b-7c269d04392b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Created volume successfully.
Nov 05 10:01:31 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-608801c4-2eca-49ea-ae60-ea0ce2c9a73f tempest-CreateVolumesFromImageTest-1272619157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b4a7e2f8-6ea9-401c-9da0-7629006c0c24" returned: 0 in 0.469s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-608801c4-2eca-49ea-ae60-ea0ce2c9a73f tempest-CreateVolumesFromImageTest-1272619157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b4a7e2f8-6ea9-401c-9da0-7629006c0c24 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:31 devstack sudo[103795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b4a7e2f8-6ea9-401c-9da0-7629006c0c24
Nov 05 10:01:31 devstack sudo[103795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:31 devstack sudo[103795]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-608801c4-2eca-49ea-ae60-ea0ce2c9a73f tempest-CreateVolumesFromImageTest-1272619157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-b4a7e2f8-6ea9-401c-9da0-7629006c0c24" returned: 0 in 0.284s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-608801c4-2eca-49ea-ae60-ea0ce2c9a73f tempest-CreateVolumesFromImageTest-1272619157 None] Lock "cinder-quobyte-b4a7e2f8-6ea9-401c-9da0-7629006c0c24" released by "delete_volume" :: held 0.816s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-608801c4-2eca-49ea-ae60-ea0ce2c9a73f tempest-CreateVolumesFromImageTest-1272619157 None] Created reservations ['49543648-709c-40c8-ae37-95cfd38dccb1', '3138befc-2813-4f85-9de2-ad54fe0506c7', 'bfb0329c-57b2-40d5-8f58-5ae1cd463bf0', 'e1bf8f52-c402-4d9a-8d81-4b1d7954fbfb'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:01:32 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d411f920-45d6-4eca-9684-725fe9c8ce24 1073741824" returned: 0 in 0.492s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d411f920-45d6-4eca-9684-725fe9c8ce24 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:32 devstack sudo[103801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d411f920-45d6-4eca-9684-725fe9c8ce24
Nov 05 10:01:32 devstack sudo[103801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-608801c4-2eca-49ea-ae60-ea0ce2c9a73f tempest-CreateVolumesFromImageTest-1272619157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-608801c4-2eca-49ea-ae60-ea0ce2c9a73f tempest-CreateVolumesFromImageTest-1272619157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-608801c4-2eca-49ea-ae60-ea0ce2c9a73f tempest-CreateVolumesFromImageTest-1272619157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-608801c4-2eca-49ea-ae60-ea0ce2c9a73f tempest-CreateVolumesFromImageTest-1272619157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-608801c4-2eca-49ea-ae60-ea0ce2c9a73f tempest-CreateVolumesFromImageTest-1272619157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-608801c4-2eca-49ea-ae60-ea0ce2c9a73f tempest-CreateVolumesFromImageTest-1272619157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:32 devstack sudo[103803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:01:32 devstack sudo[103803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-154ad93f-d9c2-4569-b871-1387e2419611 tempest-CreateVolumesFromImageTest-1272619157 None] Acquiring lock "cinder-ecfc693e-2b3e-4c57-b5f3-d740cd533dfb-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-154ad93f-d9c2-4569-b871-1387e2419611 tempest-CreateVolumesFromImageTest-1272619157 None] Lock "cinder-ecfc693e-2b3e-4c57-b5f3-d740cd533dfb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-154ad93f-d9c2-4569-b871-1387e2419611 tempest-CreateVolumesFromImageTest-1272619157 None] Acquiring lock "cinder-quobyte-ecfc693e-2b3e-4c57-b5f3-d740cd533dfb" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-154ad93f-d9c2-4569-b871-1387e2419611 tempest-CreateVolumesFromImageTest-1272619157 None] Lock "cinder-quobyte-ecfc693e-2b3e-4c57-b5f3-d740cd533dfb" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fb03c4-771b-4f6c-b4ab-661f2e4d87a6]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-154ad93f-d9c2-4569-b871-1387e2419611 tempest-CreateVolumesFromImageTest-1272619157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ecfc693e-2b3e-4c57-b5f3-d740cd533dfb {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:32 devstack sudo[103801]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d411f920-45d6-4eca-9684-725fe9c8ce24" returned: 0 in 0.326s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.354s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-565819307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7816517-9926-4a64-951f-3d9aace52fbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3a26c337be4d6db39a9da228a97d9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:26Z,use_quota=True,user_id='a05599b10dc54692a1a6bd8304396278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Creating volume f7816517-9926-4a64-951f-3d9aace52fbb {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:01:32 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f7816517-9926-4a64-951f-3d9aace52fbb 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:32 devstack sudo[103803]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7517313-df21-41d9-820f-18ddd3654a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d411f920-45d6-4eca-9684-725fe9c8ce24', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:32 devstack sudo[103808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f7816517-9926-4a64-951f-3d9aace52fbb 1073741824
Nov 05 10:01:32 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58a6dccb-ca6f-4abd-8bed-15a6bf298d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-608801c4-2eca-49ea-ae60-ea0ce2c9a73f tempest-CreateVolumesFromImageTest-1272619157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.357s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-608801c4-2eca-49ea-ae60-ea0ce2c9a73f tempest-CreateVolumesFromImageTest-1272619157 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:01:32 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-608801c4-2eca-49ea-ae60-ea0ce2c9a73f tempest-CreateVolumesFromImageTest-1272619157 None] Deleted volume successfully.
Nov 05 10:01:32 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Volume volume-d411f920-45d6-4eca-9684-725fe9c8ce24 (d411f920-45d6-4eca-9684-725fe9c8ce24): created successfully
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58a6dccb-ca6f-4abd-8bed-15a6bf298d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:32 devstack sudo[103806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ecfc693e-2b3e-4c57-b5f3-d740cd533dfb
Nov 05 10:01:32 devstack sudo[103806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Flow 'volume_create_manager' (0895fd8d-8bb5-4746-a34c-63f66b8f7203) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-608801c4-2eca-49ea-ae60-ea0ce2c9a73f tempest-CreateVolumesFromImageTest-1272619157 None] Lock "cinder-b4a7e2f8-6ea9-401c-9da0-7629006c0c24-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:32 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-1405de97-2e55-4ef9-ac22-bca99a8cb634 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Created volume successfully.
Nov 05 10:01:32 devstack sudo[103806]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-154ad93f-d9c2-4569-b871-1387e2419611 tempest-CreateVolumesFromImageTest-1272619157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ecfc693e-2b3e-4c57-b5f3-d740cd533dfb" returned: 0 in 0.418s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-154ad93f-d9c2-4569-b871-1387e2419611 tempest-CreateVolumesFromImageTest-1272619157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ecfc693e-2b3e-4c57-b5f3-d740cd533dfb {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:32 devstack sudo[103817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ecfc693e-2b3e-4c57-b5f3-d740cd533dfb
Nov 05 10:01:32 devstack sudo[103817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:33 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f7816517-9926-4a64-951f-3d9aace52fbb 1073741824" returned: 0 in 0.544s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f7816517-9926-4a64-951f-3d9aace52fbb {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:33 devstack sudo[103820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f7816517-9926-4a64-951f-3d9aace52fbb
Nov 05 10:01:33 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:33 devstack sudo[103817]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-154ad93f-d9c2-4569-b871-1387e2419611 tempest-CreateVolumesFromImageTest-1272619157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ecfc693e-2b3e-4c57-b5f3-d740cd533dfb" returned: 0 in 0.274s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-154ad93f-d9c2-4569-b871-1387e2419611 tempest-CreateVolumesFromImageTest-1272619157 None] Lock "cinder-quobyte-ecfc693e-2b3e-4c57-b5f3-d740cd533dfb" released by "delete_volume" :: held 0.750s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-154ad93f-d9c2-4569-b871-1387e2419611 tempest-CreateVolumesFromImageTest-1272619157 None] Created reservations ['0a442949-854c-4ade-9902-3245a2ce62fd', '1073afe1-faa9-41e0-95d2-aff13e956d33', '8eb363c6-1260-4351-b4a5-9c485e279fe7', 'd6faea6a-c506-4a62-b796-cc09e3b9d23a'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-154ad93f-d9c2-4569-b871-1387e2419611 tempest-CreateVolumesFromImageTest-1272619157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-154ad93f-d9c2-4569-b871-1387e2419611 tempest-CreateVolumesFromImageTest-1272619157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-154ad93f-d9c2-4569-b871-1387e2419611 tempest-CreateVolumesFromImageTest-1272619157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-154ad93f-d9c2-4569-b871-1387e2419611 tempest-CreateVolumesFromImageTest-1272619157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-154ad93f-d9c2-4569-b871-1387e2419611 tempest-CreateVolumesFromImageTest-1272619157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-154ad93f-d9c2-4569-b871-1387e2419611 tempest-CreateVolumesFromImageTest-1272619157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:33 devstack sudo[103822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:01:33 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:33 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f7816517-9926-4a64-951f-3d9aace52fbb" returned: 0 in 0.280s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.501s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3dc203e-63b4-4d92-8bbb-0758c6a54d42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e3110ab3add4862b527219163a70a03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:24Z,use_quota=True,user_id='08ef20a52868468baf72417e693cbb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed6b848d-b6f3-4b4b-8c77-d1db767f5b53),volume_type_id=ed6b848d-b6f3-4b4b-8c77-d1db767f5b53)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Creating volume a3dc203e-63b4-4d92-8bbb-0758c6a54d42 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:01:33 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a3dc203e-63b4-4d92-8bbb-0758c6a54d42 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef3130be-c150-4a60-8caa-ac52c4e78e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7816517-9926-4a64-951f-3d9aace52fbb', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:33 devstack sudo[103825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a3dc203e-63b4-4d92-8bbb-0758c6a54d42 1073741824
Nov 05 10:01:33 devstack sudo[103825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4bb160f-a9d4-4b16-9983-5f6491bb38bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:33 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Volume volume-f7816517-9926-4a64-951f-3d9aace52fbb (f7816517-9926-4a64-951f-3d9aace52fbb): created successfully
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4bb160f-a9d4-4b16-9983-5f6491bb38bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Flow 'volume_create_manager' (d843a141-0623-4a29-bf0c-2110cff74f27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:33 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-83f2b8ee-b421-490e-b34a-bc8de27e1afa tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Created volume successfully.
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-47f872f9-a6f5-458c-8b6e-b104114c43ac tempest-CreateVolumesFromImageTest-1272619157 None] Acquiring lock "cinder-53c261d4-0c02-4450-a45d-f710951eaaa5-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-47f872f9-a6f5-458c-8b6e-b104114c43ac tempest-CreateVolumesFromImageTest-1272619157 None] Lock "cinder-53c261d4-0c02-4450-a45d-f710951eaaa5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-47f872f9-a6f5-458c-8b6e-b104114c43ac tempest-CreateVolumesFromImageTest-1272619157 None] Acquiring lock "cinder-quobyte-53c261d4-0c02-4450-a45d-f710951eaaa5" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:33 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-154ad93f-d9c2-4569-b871-1387e2419611 tempest-CreateVolumesFromImageTest-1272619157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.298s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-154ad93f-d9c2-4569-b871-1387e2419611 tempest-CreateVolumesFromImageTest-1272619157 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:01:33 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-154ad93f-d9c2-4569-b871-1387e2419611 tempest-CreateVolumesFromImageTest-1272619157 None] Deleted volume successfully.
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-47f872f9-a6f5-458c-8b6e-b104114c43ac tempest-CreateVolumesFromImageTest-1272619157 None] Lock "cinder-quobyte-53c261d4-0c02-4450-a45d-f710951eaaa5" acquired by "delete_volume" :: waited 0.026s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-154ad93f-d9c2-4569-b871-1387e2419611 tempest-CreateVolumesFromImageTest-1272619157 None] Lock "cinder-ecfc693e-2b3e-4c57-b5f3-d740cd533dfb-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cfe000-d60d-42f2-9b33-4f0b39204533]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47f872f9-a6f5-458c-8b6e-b104114c43ac tempest-CreateVolumesFromImageTest-1272619157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-53c261d4-0c02-4450-a45d-f710951eaaa5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0c6ea7f1-8c6b-41b1-bc2a-e7acc716a411 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Acquiring lock "cinder-f7816517-9926-4a64-951f-3d9aace52fbb-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:33 devstack sudo[103830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-53c261d4-0c02-4450-a45d-f710951eaaa5
Nov 05 10:01:33 devstack sudo[103830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0c6ea7f1-8c6b-41b1-bc2a-e7acc716a411 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "cinder-f7816517-9926-4a64-951f-3d9aace52fbb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0c6ea7f1-8c6b-41b1-bc2a-e7acc716a411 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Acquiring lock "cinder-quobyte-f7816517-9926-4a64-951f-3d9aace52fbb" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0c6ea7f1-8c6b-41b1-bc2a-e7acc716a411 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "cinder-quobyte-f7816517-9926-4a64-951f-3d9aace52fbb" acquired by "delete_volume" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e77dcd-0e58-46ec-b471-e9134869fffe]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0c6ea7f1-8c6b-41b1-bc2a-e7acc716a411 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f7816517-9926-4a64-951f-3d9aace52fbb {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:33 devstack sudo[103825]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a3dc203e-63b4-4d92-8bbb-0758c6a54d42 1073741824" returned: 0 in 0.599s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a3dc203e-63b4-4d92-8bbb-0758c6a54d42 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:34 devstack sudo[103834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a3dc203e-63b4-4d92-8bbb-0758c6a54d42
Nov 05 10:01:34 devstack sudo[103834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:34 devstack sudo[103833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f7816517-9926-4a64-951f-3d9aace52fbb
Nov 05 10:01:34 devstack sudo[103833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:34 devstack sudo[103830]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47f872f9-a6f5-458c-8b6e-b104114c43ac tempest-CreateVolumesFromImageTest-1272619157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-53c261d4-0c02-4450-a45d-f710951eaaa5" returned: 0 in 0.503s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47f872f9-a6f5-458c-8b6e-b104114c43ac tempest-CreateVolumesFromImageTest-1272619157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-53c261d4-0c02-4450-a45d-f710951eaaa5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:34 devstack sudo[103840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-53c261d4-0c02-4450-a45d-f710951eaaa5
Nov 05 10:01:34 devstack sudo[103840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:34 devstack sudo[103834]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a3dc203e-63b4-4d92-8bbb-0758c6a54d42" returned: 0 in 0.266s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.066s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1032083001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28aa6776-fbb7-4e65-a3e0-0cb6ebead596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='818eba8a7d7044d99f976244633bd2e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:28Z,use_quota=True,user_id='6728f8d617f240b0a33dfb9758764bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] Creating volume 28aa6776-fbb7-4e65-a3e0-0cb6ebead596 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:01:34 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-28aa6776-fbb7-4e65-a3e0-0cb6ebead596 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:34 devstack sudo[103847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-28aa6776-fbb7-4e65-a3e0-0cb6ebead596 1073741824
Nov 05 10:01:34 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Attempting download of fdc9bb51-fb4c-48b3-b6c7-80ceb0026333 ((None, [{'url': 'file:///opt/stack/data/glance/images/fdc9bb51-fb4c-48b3-b6c7-80ceb0026333', 'metadata': {}}])) to volume a3dc203e-63b4-4d92-8bbb-0758c6a54d42. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 10:01:34 devstack sudo[103833]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0c6ea7f1-8c6b-41b1-bc2a-e7acc716a411 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f7816517-9926-4a64-951f-3d9aace52fbb" returned: 0 in 0.443s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0c6ea7f1-8c6b-41b1-bc2a-e7acc716a411 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f7816517-9926-4a64-951f-3d9aace52fbb {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:34 devstack sudo[103849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f7816517-9926-4a64-951f-3d9aace52fbb
Nov 05 10:01:34 devstack sudo[103849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[923daf75-07ad-407f-9565-f0c2053cf353]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fdc9bb51-fb4c-48b3-b6c7-80ceb0026333_ox9fiecc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:34 devstack sudo[103840]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47f872f9-a6f5-458c-8b6e-b104114c43ac tempest-CreateVolumesFromImageTest-1272619157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-53c261d4-0c02-4450-a45d-f710951eaaa5" returned: 0 in 0.299s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-47f872f9-a6f5-458c-8b6e-b104114c43ac tempest-CreateVolumesFromImageTest-1272619157 None] Lock "cinder-quobyte-53c261d4-0c02-4450-a45d-f710951eaaa5" released by "delete_volume" :: held 0.890s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-47f872f9-a6f5-458c-8b6e-b104114c43ac tempest-CreateVolumesFromImageTest-1272619157 None] Created reservations ['dc14e304-1f5a-4320-ab24-c4d7cc8fdad9', 'd57291ff-92d1-472f-9c78-9a62c8114688', '22557567-cc0d-4714-ba96-14f677a413e6', '6c6796ea-219f-4ebf-84e6-30bf0a91dad4'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:01:34 devstack sudo[103852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fdc9bb51-fb4c-48b3-b6c7-80ceb0026333_ox9fiecc
Nov 05 10:01:34 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:34 devstack sudo[103849]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0c6ea7f1-8c6b-41b1-bc2a-e7acc716a411 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f7816517-9926-4a64-951f-3d9aace52fbb" returned: 0 in 0.339s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-47f872f9-a6f5-458c-8b6e-b104114c43ac tempest-CreateVolumesFromImageTest-1272619157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-47f872f9-a6f5-458c-8b6e-b104114c43ac tempest-CreateVolumesFromImageTest-1272619157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-47f872f9-a6f5-458c-8b6e-b104114c43ac tempest-CreateVolumesFromImageTest-1272619157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-47f872f9-a6f5-458c-8b6e-b104114c43ac tempest-CreateVolumesFromImageTest-1272619157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-47f872f9-a6f5-458c-8b6e-b104114c43ac tempest-CreateVolumesFromImageTest-1272619157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47f872f9-a6f5-458c-8b6e-b104114c43ac tempest-CreateVolumesFromImageTest-1272619157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0c6ea7f1-8c6b-41b1-bc2a-e7acc716a411 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "cinder-quobyte-f7816517-9926-4a64-951f-3d9aace52fbb" released by "delete_volume" :: held 0.858s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8649b503-026f-40f9-948d-0c47b4ef3f65 tempest-CreateVolumesFromImageTest-1272619157 None] Acquiring lock "cinder-d78c2033-aa1d-417e-99ac-3a4ed70d328c-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:34 devstack sudo[103858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:01:34 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8649b503-026f-40f9-948d-0c47b4ef3f65 tempest-CreateVolumesFromImageTest-1272619157 None] Lock "cinder-d78c2033-aa1d-417e-99ac-3a4ed70d328c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8649b503-026f-40f9-948d-0c47b4ef3f65 tempest-CreateVolumesFromImageTest-1272619157 None] Acquiring lock "cinder-quobyte-d78c2033-aa1d-417e-99ac-3a4ed70d328c" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-0c6ea7f1-8c6b-41b1-bc2a-e7acc716a411 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Created reservations ['87908885-4cba-4c98-b306-e01d875962cd', 'ceea4745-ea4c-4869-900c-2e54a6e34a16', 'a42cdd91-fd76-42fa-b2ad-026abdc4522b', '8fd11daf-c498-4a4e-88a2-70d033c10ed0'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8649b503-026f-40f9-948d-0c47b4ef3f65 tempest-CreateVolumesFromImageTest-1272619157 None] Lock "cinder-quobyte-d78c2033-aa1d-417e-99ac-3a4ed70d328c" acquired by "delete_volume" :: waited 0.029s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:34 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fdc9bb51-fb4c-48b3-b6c7-80ceb0026333_ox9fiecc" returned: 0 in 0.512s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fdc9bb51-fb4c-48b3-b6c7-80ceb0026333_ox9fiecc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:34 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53cf6a1-8b6f-4b65-8ed4-8b4245fcd005]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8649b503-026f-40f9-948d-0c47b4ef3f65 tempest-CreateVolumesFromImageTest-1272619157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d78c2033-aa1d-417e-99ac-3a4ed70d328c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-28aa6776-fbb7-4e65-a3e0-0cb6ebead596 1073741824" returned: 0 in 0.691s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:35 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-28aa6776-fbb7-4e65-a3e0-0cb6ebead596 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-47f872f9-a6f5-458c-8b6e-b104114c43ac tempest-CreateVolumesFromImageTest-1272619157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.360s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-47f872f9-a6f5-458c-8b6e-b104114c43ac tempest-CreateVolumesFromImageTest-1272619157 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:01:35 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-47f872f9-a6f5-458c-8b6e-b104114c43ac tempest-CreateVolumesFromImageTest-1272619157 None] Deleted volume successfully.
Nov 05 10:01:35 devstack sudo[103865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-28aa6776-fbb7-4e65-a3e0-0cb6ebead596
Nov 05 10:01:35 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0c6ea7f1-8c6b-41b1-bc2a-e7acc716a411 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0c6ea7f1-8c6b-41b1-bc2a-e7acc716a411 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0c6ea7f1-8c6b-41b1-bc2a-e7acc716a411 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0c6ea7f1-8c6b-41b1-bc2a-e7acc716a411 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0c6ea7f1-8c6b-41b1-bc2a-e7acc716a411 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0c6ea7f1-8c6b-41b1-bc2a-e7acc716a411 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:35 devstack sudo[103862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fdc9bb51-fb4c-48b3-b6c7-80ceb0026333_ox9fiecc
Nov 05 10:01:35 devstack sudo[103862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-47f872f9-a6f5-458c-8b6e-b104114c43ac tempest-CreateVolumesFromImageTest-1272619157 None] Lock "cinder-53c261d4-0c02-4450-a45d-f710951eaaa5-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:35 devstack sudo[103863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d78c2033-aa1d-417e-99ac-3a4ed70d328c
Nov 05 10:01:35 devstack sudo[103863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:35 devstack sudo[103867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:01:35 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:35 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-28aa6776-fbb7-4e65-a3e0-0cb6ebead596" returned: 0 in 0.330s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.750s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1905997799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d2ff95-0329-469c-be78-0e4362ae7c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='818eba8a7d7044d99f976244633bd2e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:28Z,use_quota=True,user_id='6728f8d617f240b0a33dfb9758764bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] Creating volume c4d2ff95-0329-469c-be78-0e4362ae7c25 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:35 devstack sudo[103862]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:01:35 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4d2ff95-0329-469c-be78-0e4362ae7c25 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:35 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0c6ea7f1-8c6b-41b1-bc2a-e7acc716a411 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.298s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fdc9bb51-fb4c-48b3-b6c7-80ceb0026333_ox9fiecc" returned: 1 in 0.508s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fdc9bb51-fb4c-48b3-b6c7-80ceb0026333_ox9fiecc' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-0c6ea7f1-8c6b-41b1-bc2a-e7acc716a411 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbec9fd-7ae8-4169-8169-0c7bef1c6a69]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdc9bb51-fb4c-48b3-b6c7-80ceb0026333_zkjtppobdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:35 devstack sudo[103878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4d2ff95-0329-469c-be78-0e4362ae7c25 1073741824
Nov 05 10:01:35 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:35 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-0c6ea7f1-8c6b-41b1-bc2a-e7acc716a411 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Deleted volume successfully.
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c1655dd-7279-4ffd-881d-a10dfdd97d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28aa6776-fbb7-4e65-a3e0-0cb6ebead596', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebab9680-c627-4515-bb9c-cb8e81724868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:35 devstack sudo[103863]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8649b503-026f-40f9-948d-0c47b4ef3f65 tempest-CreateVolumesFromImageTest-1272619157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d78c2033-aa1d-417e-99ac-3a4ed70d328c" returned: 0 in 0.526s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8649b503-026f-40f9-948d-0c47b4ef3f65 tempest-CreateVolumesFromImageTest-1272619157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d78c2033-aa1d-417e-99ac-3a4ed70d328c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:35 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] Volume volume-28aa6776-fbb7-4e65-a3e0-0cb6ebead596 (28aa6776-fbb7-4e65-a3e0-0cb6ebead596): created successfully
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebab9680-c627-4515-bb9c-cb8e81724868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:35 devstack sudo[103881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d78c2033-aa1d-417e-99ac-3a4ed70d328c
Nov 05 10:01:35 devstack sudo[103881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] Flow 'volume_create_manager' (9d565f75-7283-4780-bcf4-66b29634d49d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0c6ea7f1-8c6b-41b1-bc2a-e7acc716a411 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "cinder-f7816517-9926-4a64-951f-3d9aace52fbb-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:35 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-43c4b8b7-551d-4dac-b6a0-853a0c7334de tempest-CreateVolumesFromSnapshotTest-745460845 None] Created volume successfully.
Nov 05 10:01:35 devstack sudo[103880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdc9bb51-fb4c-48b3-b6c7-80ceb0026333_zkjtppobdevstack@QuobyteHD
Nov 05 10:01:35 devstack sudo[103880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:35 devstack sudo[103881]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8649b503-026f-40f9-948d-0c47b4ef3f65 tempest-CreateVolumesFromImageTest-1272619157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d78c2033-aa1d-417e-99ac-3a4ed70d328c" returned: 0 in 0.307s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8649b503-026f-40f9-948d-0c47b4ef3f65 tempest-CreateVolumesFromImageTest-1272619157 None] Lock "cinder-quobyte-d78c2033-aa1d-417e-99ac-3a4ed70d328c" released by "delete_volume" :: held 0.933s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:35 devstack sudo[103880]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fdc9bb51-fb4c-48b3-b6c7-80ceb0026333_zkjtppobdevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdc9bb51-fb4c-48b3-b6c7-80ceb0026333_zkjtppobdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-8649b503-026f-40f9-948d-0c47b4ef3f65 tempest-CreateVolumesFromImageTest-1272619157 None] Created reservations ['d73af2a1-e617-4a5a-b27c-aae537e0fce9', '7990796b-8ff9-4bdf-9151-dec0e3ff2c37', 'e264f798-5689-472e-b186-a9b32091d9bf', '43985a36-1c65-4071-98b1-e17e16224d69'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:01:35 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4d2ff95-0329-469c-be78-0e4362ae7c25 1073741824" returned: 0 in 0.533s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:35 devstack sudo[103891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdc9bb51-fb4c-48b3-b6c7-80ceb0026333_zkjtppobdevstack@QuobyteHD
Nov 05 10:01:35 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4d2ff95-0329-469c-be78-0e4362ae7c25 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8649b503-026f-40f9-948d-0c47b4ef3f65 tempest-CreateVolumesFromImageTest-1272619157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8649b503-026f-40f9-948d-0c47b4ef3f65 tempest-CreateVolumesFromImageTest-1272619157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8649b503-026f-40f9-948d-0c47b4ef3f65 tempest-CreateVolumesFromImageTest-1272619157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8649b503-026f-40f9-948d-0c47b4ef3f65 tempest-CreateVolumesFromImageTest-1272619157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8649b503-026f-40f9-948d-0c47b4ef3f65 tempest-CreateVolumesFromImageTest-1272619157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8649b503-026f-40f9-948d-0c47b4ef3f65 tempest-CreateVolumesFromImageTest-1272619157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:36 devstack sudo[103893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4d2ff95-0329-469c-be78-0e4362ae7c25
Nov 05 10:01:36 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:36 devstack sudo[103895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:01:36 devstack sudo[103895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-91d2d3b8-3068-4d59-a4f7-afc417204958 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Acquiring lock "cinder-d411f920-45d6-4eca-9684-725fe9c8ce24-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-91d2d3b8-3068-4d59-a4f7-afc417204958 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "cinder-d411f920-45d6-4eca-9684-725fe9c8ce24-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-91d2d3b8-3068-4d59-a4f7-afc417204958 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Acquiring lock "cinder-quobyte-d411f920-45d6-4eca-9684-725fe9c8ce24" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-91d2d3b8-3068-4d59-a4f7-afc417204958 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "cinder-quobyte-d411f920-45d6-4eca-9684-725fe9c8ce24" acquired by "delete_volume" :: waited 0.030s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:36 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc85972f-c0a7-479e-b271-3fc3892a7516]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-91d2d3b8-3068-4d59-a4f7-afc417204958 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d411f920-45d6-4eca-9684-725fe9c8ce24 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdc9bb51-fb4c-48b3-b6c7-80ceb0026333_zkjtppobdevstack@QuobyteHD" returned: 1 in 0.484s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fdc9bb51-fb4c-48b3-b6c7-80ceb0026333_zkjtppobdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] fdc9bb51-fb4c-48b3-b6c7-80ceb0026333 was raw, converting to qcow2 {{(pid=86649) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 10:01:36 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fdc9bb51-fb4c-48b3-b6c7-80ceb0026333_zkjtppobdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a3dc203e-63b4-4d92-8bbb-0758c6a54d42 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4d2ff95-0329-469c-be78-0e4362ae7c25" returned: 0 in 0.346s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.287s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1222999438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4f26208-8ea2-4f01-94c7-5ccd44cbac5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='818eba8a7d7044d99f976244633bd2e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:29Z,use_quota=True,user_id='6728f8d617f240b0a33dfb9758764bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] Creating volume e4f26208-8ea2-4f01-94c7-5ccd44cbac5f {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:36 devstack sudo[103903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fdc9bb51-fb4c-48b3-b6c7-80ceb0026333_zkjtppobdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a3dc203e-63b4-4d92-8bbb-0758c6a54d42
Nov 05 10:01:36 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:01:36 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e4f26208-8ea2-4f01-94c7-5ccd44cbac5f 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:36 devstack sudo[103895]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8649b503-026f-40f9-948d-0c47b4ef3f65 tempest-CreateVolumesFromImageTest-1272619157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.370s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-8649b503-026f-40f9-948d-0c47b4ef3f65 tempest-CreateVolumesFromImageTest-1272619157 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:01:36 devstack sudo[103905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e4f26208-8ea2-4f01-94c7-5ccd44cbac5f 1073741824
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08c8929-d3ca-44ee-9ce1-beeaa848b7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4d2ff95-0329-469c-be78-0e4362ae7c25', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:36 devstack sudo[103905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b9c4c59-1d0d-4d92-9e18-098ce3da65b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:36 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-8649b503-026f-40f9-948d-0c47b4ef3f65 tempest-CreateVolumesFromImageTest-1272619157 None] Deleted volume successfully.
Nov 05 10:01:36 devstack sudo[103901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d411f920-45d6-4eca-9684-725fe9c8ce24
Nov 05 10:01:36 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:36 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] Volume volume-c4d2ff95-0329-469c-be78-0e4362ae7c25 (c4d2ff95-0329-469c-be78-0e4362ae7c25): created successfully
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b9c4c59-1d0d-4d92-9e18-098ce3da65b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] Flow 'volume_create_manager' (f40bb3c7-64e3-4398-9101-3a1988cf6c52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-8649b503-026f-40f9-948d-0c47b4ef3f65 tempest-CreateVolumesFromImageTest-1272619157 None] Lock "cinder-d78c2033-aa1d-417e-99ac-3a4ed70d328c-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:36 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-dfb53439-31fc-4bfa-b772-85e8e8e21f1e tempest-CreateVolumesFromSnapshotTest-745460845 None] Created volume successfully.
Nov 05 10:01:36 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-91d2d3b8-3068-4d59-a4f7-afc417204958 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d411f920-45d6-4eca-9684-725fe9c8ce24" returned: 0 in 0.485s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-91d2d3b8-3068-4d59-a4f7-afc417204958 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d411f920-45d6-4eca-9684-725fe9c8ce24 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:36 devstack sudo[103917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d411f920-45d6-4eca-9684-725fe9c8ce24
Nov 05 10:01:36 devstack sudo[103917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:36 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fdc9bb51-fb4c-48b3-b6c7-80ceb0026333_zkjtppobdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a3dc203e-63b4-4d92-8bbb-0758c6a54d42" returned: 0 in 0.540s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:36 devstack sudo[103905]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fdc9bb51-fb4c-48b3-b6c7-80ceb0026333_zkjtppobdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a3dc203e-63b4-4d92-8bbb-0758c6a54d42 {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 10:01:36 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a3dc203e-63b4-4d92-8bbb-0758c6a54d42 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e4f26208-8ea2-4f01-94c7-5ccd44cbac5f 1073741824" returned: 0 in 0.518s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:36 devstack sudo[103920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a3dc203e-63b4-4d92-8bbb-0758c6a54d42 1G
Nov 05 10:01:36 devstack sudo[103920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e4f26208-8ea2-4f01-94c7-5ccd44cbac5f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:36 devstack sudo[103922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e4f26208-8ea2-4f01-94c7-5ccd44cbac5f
Nov 05 10:01:36 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:37 devstack sudo[103917]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-91d2d3b8-3068-4d59-a4f7-afc417204958 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d411f920-45d6-4eca-9684-725fe9c8ce24" returned: 0 in 0.332s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-91d2d3b8-3068-4d59-a4f7-afc417204958 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "cinder-quobyte-d411f920-45d6-4eca-9684-725fe9c8ce24" released by "delete_volume" :: held 0.897s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-91d2d3b8-3068-4d59-a4f7-afc417204958 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Created reservations ['feaf75cb-1a80-46da-8a0c-69aa6918a8c6', 'c195b9d4-e0c9-42e7-9da3-a5392bed9045', '31221dd0-a92a-46b3-91b8-85f62c84e01f', '32ade0e1-049f-4a39-b8f9-6abbaf5cd614'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:01:37 devstack sudo[103920]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:37 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a3dc203e-63b4-4d92-8bbb-0758c6a54d42 1G" returned: 0 in 0.390s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Downloaded image fdc9bb51-fb4c-48b3-b6c7-80ceb0026333 ((None, [{'url': 'file:///opt/stack/data/glance/images/fdc9bb51-fb4c-48b3-b6c7-80ceb0026333', 'metadata': {}}])) to volume a3dc203e-63b4-4d92-8bbb-0758c6a54d42 successfully. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Temporary image fdc9bb51-fb4c-48b3-b6c7-80ceb0026333 for user 08ef20a52868468baf72417e693cbb90 is deleted. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Marking volume a3dc203e-63b4-4d92-8bbb-0758c6a54d42 as bootable. {{(pid=86649) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e4f26208-8ea2-4f01-94c7-5ccd44cbac5f" returned: 0 in 0.340s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.811s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1950522510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25459d8d-fa31-4e6d-9875-af6120698f59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='818eba8a7d7044d99f976244633bd2e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:29Z,use_quota=True,user_id='6728f8d617f240b0a33dfb9758764bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] Creating volume 25459d8d-fa31-4e6d-9875-af6120698f59 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:01:37 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-25459d8d-fa31-4e6d-9875-af6120698f59 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Copying metadata from image fdc9bb51-fb4c-48b3-b6c7-80ceb0026333 to a3dc203e-63b4-4d92-8bbb-0758c6a54d42. {{(pid=86649) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Creating volume glance metadata for volume a3dc203e-63b4-4d92-8bbb-0758c6a54d42 backed by image fdc9bb51-fb4c-48b3-b6c7-80ceb0026333 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'fdc9bb51-fb4c-48b3-b6c7-80ceb0026333', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '97c18e7d669702b7fba0bf8113e75045', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86649) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43c231f5-ad84-44c2-87a3-247870f04113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4f26208-8ea2-4f01-94c7-5ccd44cbac5f', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:37 devstack sudo[103930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-25459d8d-fa31-4e6d-9875-af6120698f59 1073741824
Nov 05 10:01:37 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2480fd5d-1be2-4344-8fb1-27d4311dc6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:37 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] Volume volume-e4f26208-8ea2-4f01-94c7-5ccd44cbac5f (e4f26208-8ea2-4f01-94c7-5ccd44cbac5f): created successfully
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2480fd5d-1be2-4344-8fb1-27d4311dc6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] Flow 'volume_create_manager' (2c9b572a-d102-4a0b-aca0-9bb361c19548) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-91d2d3b8-3068-4d59-a4f7-afc417204958 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-91d2d3b8-3068-4d59-a4f7-afc417204958 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-91d2d3b8-3068-4d59-a4f7-afc417204958 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-91d2d3b8-3068-4d59-a4f7-afc417204958 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-91d2d3b8-3068-4d59-a4f7-afc417204958 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-91d2d3b8-3068-4d59-a4f7-afc417204958 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cbd9bfaf-a3fe-45ff-a96b-664f608bd59f tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Acquiring lock "cinder-343a3daf-3808-49bf-8236-b707afae381b-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:37 devstack sudo[103932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:01:37 devstack sudo[103932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:37 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-9fde6bd5-1103-4486-8a18-72c70972a626 tempest-CreateVolumesFromSnapshotTest-745460845 None] Created volume successfully.
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cbd9bfaf-a3fe-45ff-a96b-664f608bd59f tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "cinder-343a3daf-3808-49bf-8236-b707afae381b-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cbd9bfaf-a3fe-45ff-a96b-664f608bd59f tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Acquiring lock "cinder-quobyte-343a3daf-3808-49bf-8236-b707afae381b" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab3f9174-5012-4a21-a369-90944f68be40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3dc203e-63b4-4d92-8bbb-0758c6a54d42', 'volume_size': 1, 'image_id': 'fdc9bb51-fb4c-48b3-b6c7-80ceb0026333', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fdc9bb51-fb4c-48b3-b6c7-80ceb0026333', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '97c18e7d669702b7fba0bf8113e75045', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9e3110ab3add4862b527219163a70a03', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '130e01ada31f04bffc29628d268625531690b69679ff1a7a90e67cafc56daf42a8ea96163e099b2a94cbfb67a24b4e6121e3fe623ef54c09648471465c748f02', 'id': 'fdc9bb51-fb4c-48b3-b6c7-80ceb0026333', 'created_at': datetime.datetime(2026, 11, 5, 9, 1, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 9, 1, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fdc9bb51-fb4c-48b3-b6c7-80ceb0026333/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78419c2d1310>}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce97c8d0-473c-4f56-9978-a595392a0ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cbd9bfaf-a3fe-45ff-a96b-664f608bd59f tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "cinder-quobyte-343a3daf-3808-49bf-8236-b707afae381b" acquired by "delete_volume" :: waited 0.061s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:37 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Volume volume-a3dc203e-63b4-4d92-8bbb-0758c6a54d42 (a3dc203e-63b4-4d92-8bbb-0758c6a54d42): created successfully
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce97c8d0-473c-4f56-9978-a595392a0ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Flow 'volume_create_manager' (bad4aca3-abed-492f-a008-ccd181a6b1f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2bdd4d-260a-4500-a6d7-b4e1bafc7adc]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cbd9bfaf-a3fe-45ff-a96b-664f608bd59f tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-343a3daf-3808-49bf-8236-b707afae381b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:37 devstack sudo[103932]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-91d2d3b8-3068-4d59-a4f7-afc417204958 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.427s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-91d2d3b8-3068-4d59-a4f7-afc417204958 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:01:37 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-91d2d3b8-3068-4d59-a4f7-afc417204958 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Deleted volume successfully.
Nov 05 10:01:37 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-23b7cdc3-b35e-4560-949d-1b64eaa5eab9 tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Created volume successfully.
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-91d2d3b8-3068-4d59-a4f7-afc417204958 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "cinder-d411f920-45d6-4eca-9684-725fe9c8ce24-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:37 devstack sudo[103938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-343a3daf-3808-49bf-8236-b707afae381b
Nov 05 10:01:37 devstack sudo[103938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:37 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-25459d8d-fa31-4e6d-9875-af6120698f59 1073741824" returned: 0 in 0.696s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-25459d8d-fa31-4e6d-9875-af6120698f59 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:38 devstack sudo[103942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-25459d8d-fa31-4e6d-9875-af6120698f59
Nov 05 10:01:38 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:38 devstack sudo[103938]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cbd9bfaf-a3fe-45ff-a96b-664f608bd59f tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-343a3daf-3808-49bf-8236-b707afae381b" returned: 0 in 0.465s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cbd9bfaf-a3fe-45ff-a96b-664f608bd59f tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-343a3daf-3808-49bf-8236-b707afae381b {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:38 devstack sudo[103947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-343a3daf-3808-49bf-8236-b707afae381b
Nov 05 10:01:38 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:38 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-25459d8d-fa31-4e6d-9875-af6120698f59" returned: 0 in 0.298s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:01:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.486s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-506882322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d54809-1625-4bd2-a01d-c64d631466c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='818eba8a7d7044d99f976244633bd2e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:30Z,use_quota=True,user_id='6728f8d617f240b0a33dfb9758764bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:01:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] Creating volume 36d54809-1625-4bd2-a01d-c64d631466c1 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:01:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:38 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:01:38 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:01:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-36d54809-1625-4bd2-a01d-c64d631466c1 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22ba9efc-000a-448b-b95d-d901704bae4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25459d8d-fa31-4e6d-9875-af6120698f59', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad0bf78b-90fb-48d7-a9e6-d8fc414dce78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:38 devstack sudo[103950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-36d54809-1625-4bd2-a01d-c64d631466c1 1073741824
Nov 05 10:01:38 devstack sudo[103950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:38 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] Volume volume-25459d8d-fa31-4e6d-9875-af6120698f59 (25459d8d-fa31-4e6d-9875-af6120698f59): created successfully
Nov 05 10:01:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad0bf78b-90fb-48d7-a9e6-d8fc414dce78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] Flow 'volume_create_manager' (80be4314-f432-4ce9-9a7d-c252b00cbd5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:38 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-fcd0db70-4476-430b-a975-679ec16e0346 tempest-CreateVolumesFromSnapshotTest-745460845 None] Created volume successfully.
Nov 05 10:01:38 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cbd9bfaf-a3fe-45ff-a96b-664f608bd59f tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-343a3daf-3808-49bf-8236-b707afae381b" returned: 0 in 0.340s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cbd9bfaf-a3fe-45ff-a96b-664f608bd59f tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "cinder-quobyte-343a3daf-3808-49bf-8236-b707afae381b" released by "delete_volume" :: held 0.948s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3d62bd43-a271-410d-939e-082f20e19fba tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Acquiring lock "cinder-a3dc203e-63b4-4d92-8bbb-0758c6a54d42-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3d62bd43-a271-410d-939e-082f20e19fba tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Lock "cinder-a3dc203e-63b4-4d92-8bbb-0758c6a54d42-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:38 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-cbd9bfaf-a3fe-45ff-a96b-664f608bd59f tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Created reservations ['23c0466e-d906-4d79-8a6a-a1f10d47ccd0', '23a1b544-bbc2-44b6-a7f2-eb3520e988d1', '746ae408-45c3-461b-8f1b-f411579dffe4', 'fe4f70d2-b46a-4962-8849-67a72f271262'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:01:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3d62bd43-a271-410d-939e-082f20e19fba tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Acquiring lock "cinder-quobyte-a3dc203e-63b4-4d92-8bbb-0758c6a54d42" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:38 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3d62bd43-a271-410d-939e-082f20e19fba tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Lock "cinder-quobyte-a3dc203e-63b4-4d92-8bbb-0758c6a54d42" acquired by "delete_volume" :: waited 0.035s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:38 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d32f3a9-da33-4ae8-8e3a-87355097a368]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:01:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3d62bd43-a271-410d-939e-082f20e19fba tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a3dc203e-63b4-4d92-8bbb-0758c6a54d42 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:38 devstack sudo[103950]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-36d54809-1625-4bd2-a01d-c64d631466c1 1073741824" returned: 0 in 0.661s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cbd9bfaf-a3fe-45ff-a96b-664f608bd59f tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cbd9bfaf-a3fe-45ff-a96b-664f608bd59f tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-cbd9bfaf-a3fe-45ff-a96b-664f608bd59f tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-cbd9bfaf-a3fe-45ff-a96b-664f608bd59f tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cbd9bfaf-a3fe-45ff-a96b-664f608bd59f tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cbd9bfaf-a3fe-45ff-a96b-664f608bd59f tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:39 devstack sudo[103959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-36d54809-1625-4bd2-a01d-c64d631466c1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:39 devstack sudo[103959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:39 devstack sudo[103961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-36d54809-1625-4bd2-a01d-c64d631466c1
Nov 05 10:01:39 devstack sudo[103961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:39 devstack sudo[103958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a3dc203e-63b4-4d92-8bbb-0758c6a54d42
Nov 05 10:01:39 devstack sudo[103958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:39 devstack sudo[103959]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cbd9bfaf-a3fe-45ff-a96b-664f608bd59f tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.295s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-cbd9bfaf-a3fe-45ff-a96b-664f608bd59f tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:01:39 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-cbd9bfaf-a3fe-45ff-a96b-664f608bd59f tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Deleted volume successfully.
Nov 05 10:01:39 devstack sudo[103961]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-36d54809-1625-4bd2-a01d-c64d631466c1" returned: 0 in 0.300s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cbd9bfaf-a3fe-45ff-a96b-664f608bd59f tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "cinder-343a3daf-3808-49bf-8236-b707afae381b-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee8be8c-ed43-4035-8c24-22c60640afe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36d54809-1625-4bd2-a01d-c64d631466c1', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:39 devstack sudo[103958]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b1925a-84d5-4c5f-beeb-f134993e26ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3d62bd43-a271-410d-939e-082f20e19fba tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a3dc203e-63b4-4d92-8bbb-0758c6a54d42" returned: 0 in 0.430s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3d62bd43-a271-410d-939e-082f20e19fba tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a3dc203e-63b4-4d92-8bbb-0758c6a54d42 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:39 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] Volume volume-36d54809-1625-4bd2-a01d-c64d631466c1 (36d54809-1625-4bd2-a01d-c64d631466c1): created successfully
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b1925a-84d5-4c5f-beeb-f134993e26ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:39 devstack sudo[103970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a3dc203e-63b4-4d92-8bbb-0758c6a54d42
Nov 05 10:01:39 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] Flow 'volume_create_manager' (440cef6b-651b-428a-98f6-e11e0becc4bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:39 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-0d74e676-3c43-4624-b3ac-27561cf2397a tempest-CreateVolumesFromSnapshotTest-745460845 None] Created volume successfully.
Nov 05 10:01:39 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3d62bd43-a271-410d-939e-082f20e19fba tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-a3dc203e-63b4-4d92-8bbb-0758c6a54d42" returned: 0 in 0.299s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3d62bd43-a271-410d-939e-082f20e19fba tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Lock "cinder-quobyte-a3dc203e-63b4-4d92-8bbb-0758c6a54d42" released by "delete_volume" :: held 0.786s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3e9ae23d-6ba9-4397-aa22-45abed11ea09 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Acquiring lock "cinder-c93a9b94-8fcf-414f-a74a-605752e9a3ce-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3e9ae23d-6ba9-4397-aa22-45abed11ea09 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "cinder-c93a9b94-8fcf-414f-a74a-605752e9a3ce-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-3d62bd43-a271-410d-939e-082f20e19fba tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Created reservations ['1898f151-b336-48cf-938b-2dafb18fbff8', 'aa8dfd1b-ab5f-44a4-97ac-d0be4cc91065', '61771696-2c8c-4128-8ec8-63d3cedc365f', 'd00d4106-101e-4c18-bcd9-2c2dfcbf8235'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3e9ae23d-6ba9-4397-aa22-45abed11ea09 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Acquiring lock "cinder-quobyte-c93a9b94-8fcf-414f-a74a-605752e9a3ce" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3e9ae23d-6ba9-4397-aa22-45abed11ea09 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "cinder-quobyte-c93a9b94-8fcf-414f-a74a-605752e9a3ce" acquired by "delete_volume" :: waited 0.031s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf46e705-449c-4ecd-8013-613a1cb98f24]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3e9ae23d-6ba9-4397-aa22-45abed11ea09 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c93a9b94-8fcf-414f-a74a-605752e9a3ce {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3d62bd43-a271-410d-939e-082f20e19fba tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3d62bd43-a271-410d-939e-082f20e19fba tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3d62bd43-a271-410d-939e-082f20e19fba tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3d62bd43-a271-410d-939e-082f20e19fba tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3d62bd43-a271-410d-939e-082f20e19fba tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3d62bd43-a271-410d-939e-082f20e19fba tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:40 devstack sudo[103975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:01:40 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-022dae48-5829-4c4b-9028-fab07ff776f8 tempest-CreateVolumesFromSnapshotTest-745460845 None] Acquiring lock "cinder-36d54809-1625-4bd2-a01d-c64d631466c1-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:40 devstack sudo[103974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c93a9b94-8fcf-414f-a74a-605752e9a3ce
Nov 05 10:01:40 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-022dae48-5829-4c4b-9028-fab07ff776f8 tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "cinder-36d54809-1625-4bd2-a01d-c64d631466c1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-022dae48-5829-4c4b-9028-fab07ff776f8 tempest-CreateVolumesFromSnapshotTest-745460845 None] Acquiring lock "cinder-quobyte-36d54809-1625-4bd2-a01d-c64d631466c1" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-022dae48-5829-4c4b-9028-fab07ff776f8 tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "cinder-quobyte-36d54809-1625-4bd2-a01d-c64d631466c1" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:40 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29981ee-3d8e-4c0f-b581-d26329aa216f]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:01:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-022dae48-5829-4c4b-9028-fab07ff776f8 tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-36d54809-1625-4bd2-a01d-c64d631466c1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:40 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3d62bd43-a271-410d-939e-082f20e19fba tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.355s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:40 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-3d62bd43-a271-410d-939e-082f20e19fba tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:01:40 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-3d62bd43-a271-410d-939e-082f20e19fba tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Deleted volume successfully.
Nov 05 10:01:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3d62bd43-a271-410d-939e-082f20e19fba tempest-VolumeAndVolumeTypeFromImageTest-1604649441 None] Lock "cinder-a3dc203e-63b4-4d92-8bbb-0758c6a54d42-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:40 devstack sudo[103978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-36d54809-1625-4bd2-a01d-c64d631466c1
Nov 05 10:01:40 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:40 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3e9ae23d-6ba9-4397-aa22-45abed11ea09 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c93a9b94-8fcf-414f-a74a-605752e9a3ce" returned: 0 in 0.497s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3e9ae23d-6ba9-4397-aa22-45abed11ea09 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c93a9b94-8fcf-414f-a74a-605752e9a3ce {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:40 devstack sudo[103985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c93a9b94-8fcf-414f-a74a-605752e9a3ce
Nov 05 10:01:40 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:40 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3e9ae23d-6ba9-4397-aa22-45abed11ea09 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c93a9b94-8fcf-414f-a74a-605752e9a3ce" returned: 0 in 0.303s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3e9ae23d-6ba9-4397-aa22-45abed11ea09 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "cinder-quobyte-c93a9b94-8fcf-414f-a74a-605752e9a3ce" released by "delete_volume" :: held 0.871s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:40 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-022dae48-5829-4c4b-9028-fab07ff776f8 tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-36d54809-1625-4bd2-a01d-c64d631466c1" returned: 0 in 0.560s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-022dae48-5829-4c4b-9028-fab07ff776f8 tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-36d54809-1625-4bd2-a01d-c64d631466c1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:40 devstack sudo[103991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-36d54809-1625-4bd2-a01d-c64d631466c1
Nov 05 10:01:40 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:40 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-3e9ae23d-6ba9-4397-aa22-45abed11ea09 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Created reservations ['fa67238c-acae-4c70-9264-d9ec3c01aa30', 'bf37a686-4bd4-4ee1-b2a5-47ef827b48ea', '216d3354-13ba-44ec-ba34-711a894bbfa6', '6e9d0b8f-4b4e-4d84-ac86-c227578cc550'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:01:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3e9ae23d-6ba9-4397-aa22-45abed11ea09 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3e9ae23d-6ba9-4397-aa22-45abed11ea09 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3e9ae23d-6ba9-4397-aa22-45abed11ea09 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3e9ae23d-6ba9-4397-aa22-45abed11ea09 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3e9ae23d-6ba9-4397-aa22-45abed11ea09 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3e9ae23d-6ba9-4397-aa22-45abed11ea09 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:40 devstack sudo[103993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:01:40 devstack sudo[103993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5cf23794-b3db-4054-845a-ef6a1e1a708b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Acquiring lock "cinder-c9847046-ae39-4fd1-a26f-c26d86f89142-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5cf23794-b3db-4054-845a-ef6a1e1a708b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "cinder-c9847046-ae39-4fd1-a26f-c26d86f89142-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5cf23794-b3db-4054-845a-ef6a1e1a708b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Acquiring lock "cinder-quobyte-c9847046-ae39-4fd1-a26f-c26d86f89142" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5cf23794-b3db-4054-845a-ef6a1e1a708b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "cinder-quobyte-c9847046-ae39-4fd1-a26f-c26d86f89142" acquired by "delete_volume" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:41 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ae8091-31fe-4fd0-aa5b-2b9d6060f87d]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:01:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5cf23794-b3db-4054-845a-ef6a1e1a708b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c9847046-ae39-4fd1-a26f-c26d86f89142 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:41 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-022dae48-5829-4c4b-9028-fab07ff776f8 tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-36d54809-1625-4bd2-a01d-c64d631466c1" returned: 0 in 0.431s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-022dae48-5829-4c4b-9028-fab07ff776f8 tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "cinder-quobyte-36d54809-1625-4bd2-a01d-c64d631466c1" released by "delete_volume" :: held 1.058s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:41 devstack sudo[103993]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3e9ae23d-6ba9-4397-aa22-45abed11ea09 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.363s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:41 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-3e9ae23d-6ba9-4397-aa22-45abed11ea09 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:01:41 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-3e9ae23d-6ba9-4397-aa22-45abed11ea09 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Deleted volume successfully.
Nov 05 10:01:41 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-022dae48-5829-4c4b-9028-fab07ff776f8 tempest-CreateVolumesFromSnapshotTest-745460845 None] Created reservations ['0d9046bf-5ec7-4b03-8583-c8b41b1dc8b7', 'fc87fd36-629f-418b-a958-676c5efbcf4b', '44f45bd2-c1bd-4fd9-aaaa-81390700e162', '4a4e3af0-ac92-4f0c-bd25-f0e127061f3e'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:01:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3e9ae23d-6ba9-4397-aa22-45abed11ea09 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "cinder-c93a9b94-8fcf-414f-a74a-605752e9a3ce-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:41 devstack sudo[103996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c9847046-ae39-4fd1-a26f-c26d86f89142
Nov 05 10:01:41 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-022dae48-5829-4c4b-9028-fab07ff776f8 tempest-CreateVolumesFromSnapshotTest-745460845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-022dae48-5829-4c4b-9028-fab07ff776f8 tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-022dae48-5829-4c4b-9028-fab07ff776f8 tempest-CreateVolumesFromSnapshotTest-745460845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-022dae48-5829-4c4b-9028-fab07ff776f8 tempest-CreateVolumesFromSnapshotTest-745460845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-022dae48-5829-4c4b-9028-fab07ff776f8 tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-022dae48-5829-4c4b-9028-fab07ff776f8 tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:41 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a1382d38-2890-4985-9b3e-ba22cca2227d tempest-ProjectAdminTests-463337651 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.522720336914, 'free_capacity_gb': 1773.522720336914, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86649) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 05 10:01:41 devstack sudo[103999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:01:41 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:41 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5cf23794-b3db-4054-845a-ef6a1e1a708b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c9847046-ae39-4fd1-a26f-c26d86f89142" returned: 0 in 0.567s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5cf23794-b3db-4054-845a-ef6a1e1a708b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c9847046-ae39-4fd1-a26f-c26d86f89142 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:41 devstack sudo[104005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c9847046-ae39-4fd1-a26f-c26d86f89142
Nov 05 10:01:41 devstack sudo[104005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:41 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-022dae48-5829-4c4b-9028-fab07ff776f8 tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.358s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:41 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-022dae48-5829-4c4b-9028-fab07ff776f8 tempest-CreateVolumesFromSnapshotTest-745460845 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:01:41 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-022dae48-5829-4c4b-9028-fab07ff776f8 tempest-CreateVolumesFromSnapshotTest-745460845 None] Deleted volume successfully.
Nov 05 10:01:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-022dae48-5829-4c4b-9028-fab07ff776f8 tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "cinder-36d54809-1625-4bd2-a01d-c64d631466c1-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:42 devstack sudo[104005]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5cf23794-b3db-4054-845a-ef6a1e1a708b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c9847046-ae39-4fd1-a26f-c26d86f89142" returned: 0 in 0.302s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5cf23794-b3db-4054-845a-ef6a1e1a708b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "cinder-quobyte-c9847046-ae39-4fd1-a26f-c26d86f89142" released by "delete_volume" :: held 0.935s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:42 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-5cf23794-b3db-4054-845a-ef6a1e1a708b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Created reservations ['e5f69e6f-06cb-40df-88f6-10047c30014f', '681c16a7-9e8d-403c-88c3-387828dd2c9b', 'a7e78e93-3df2-4cb9-b466-dff5b5556891', '80955b97-e5c6-4ff9-920a-2eb0885185ea'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:01:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5cf23794-b3db-4054-845a-ef6a1e1a708b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5cf23794-b3db-4054-845a-ef6a1e1a708b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5cf23794-b3db-4054-845a-ef6a1e1a708b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5cf23794-b3db-4054-845a-ef6a1e1a708b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5cf23794-b3db-4054-845a-ef6a1e1a708b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5cf23794-b3db-4054-845a-ef6a1e1a708b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e2a3d12f-e696-404d-b1cb-97eecbb5ca0c tempest-CreateVolumesFromSnapshotTest-745460845 None] Acquiring lock "cinder-25459d8d-fa31-4e6d-9875-af6120698f59-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:42 devstack sudo[104014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:01:42 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e2a3d12f-e696-404d-b1cb-97eecbb5ca0c tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "cinder-25459d8d-fa31-4e6d-9875-af6120698f59-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e2a3d12f-e696-404d-b1cb-97eecbb5ca0c tempest-CreateVolumesFromSnapshotTest-745460845 None] Acquiring lock "cinder-quobyte-25459d8d-fa31-4e6d-9875-af6120698f59" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e2a3d12f-e696-404d-b1cb-97eecbb5ca0c tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "cinder-quobyte-25459d8d-fa31-4e6d-9875-af6120698f59" acquired by "delete_volume" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:42 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3302d8-9971-4920-909d-a220540158dd]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:01:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e2a3d12f-e696-404d-b1cb-97eecbb5ca0c tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-25459d8d-fa31-4e6d-9875-af6120698f59 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:42 devstack sudo[104016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-25459d8d-fa31-4e6d-9875-af6120698f59
Nov 05 10:01:42 devstack sudo[104016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:42 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5cf23794-b3db-4054-845a-ef6a1e1a708b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.325s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:42 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-5cf23794-b3db-4054-845a-ef6a1e1a708b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:01:42 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-5cf23794-b3db-4054-845a-ef6a1e1a708b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Deleted volume successfully.
Nov 05 10:01:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5cf23794-b3db-4054-845a-ef6a1e1a708b tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "cinder-c9847046-ae39-4fd1-a26f-c26d86f89142-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:42 devstack sudo[104016]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e2a3d12f-e696-404d-b1cb-97eecbb5ca0c tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-25459d8d-fa31-4e6d-9875-af6120698f59" returned: 0 in 0.437s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e2a3d12f-e696-404d-b1cb-97eecbb5ca0c tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-25459d8d-fa31-4e6d-9875-af6120698f59 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:43 devstack sudo[104022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-25459d8d-fa31-4e6d-9875-af6120698f59
Nov 05 10:01:43 devstack sudo[104022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:43 devstack sudo[104022]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e2a3d12f-e696-404d-b1cb-97eecbb5ca0c tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-25459d8d-fa31-4e6d-9875-af6120698f59" returned: 0 in 0.293s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e2a3d12f-e696-404d-b1cb-97eecbb5ca0c tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "cinder-quobyte-25459d8d-fa31-4e6d-9875-af6120698f59" released by "delete_volume" :: held 0.793s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-08e16926-8472-4812-8cf6-b230c957bff2 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Acquiring lock "cinder-6d658e23-bc7a-4275-8c26-f1022995dda0-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-08e16926-8472-4812-8cf6-b230c957bff2 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "cinder-6d658e23-bc7a-4275-8c26-f1022995dda0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:43 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-e2a3d12f-e696-404d-b1cb-97eecbb5ca0c tempest-CreateVolumesFromSnapshotTest-745460845 None] Created reservations ['686a893f-a4c6-404d-9baf-de18c5fe5c3f', 'f98f415d-a40d-4343-8e4f-d1d164aae8b7', 'f3e9164e-0bd2-49a9-a09e-0c94abf59b6e', '1bae4c9d-56df-4e06-9096-bc9d5257247f'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:01:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-08e16926-8472-4812-8cf6-b230c957bff2 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Acquiring lock "cinder-quobyte-6d658e23-bc7a-4275-8c26-f1022995dda0" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-08e16926-8472-4812-8cf6-b230c957bff2 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "cinder-quobyte-6d658e23-bc7a-4275-8c26-f1022995dda0" acquired by "delete_volume" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:43 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f4b8fc-f1f7-4cce-8414-1ddbed42cc51]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:01:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-08e16926-8472-4812-8cf6-b230c957bff2 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6d658e23-bc7a-4275-8c26-f1022995dda0 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e2a3d12f-e696-404d-b1cb-97eecbb5ca0c tempest-CreateVolumesFromSnapshotTest-745460845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e2a3d12f-e696-404d-b1cb-97eecbb5ca0c tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e2a3d12f-e696-404d-b1cb-97eecbb5ca0c tempest-CreateVolumesFromSnapshotTest-745460845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e2a3d12f-e696-404d-b1cb-97eecbb5ca0c tempest-CreateVolumesFromSnapshotTest-745460845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e2a3d12f-e696-404d-b1cb-97eecbb5ca0c tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e2a3d12f-e696-404d-b1cb-97eecbb5ca0c tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:43 devstack sudo[104026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:01:43 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-83b712da-69e6-4dbf-9dc6-8436e5703030 tempest-CreateVolumesFromSnapshotTest-745460845 None] Acquiring lock "cinder-e4f26208-8ea2-4f01-94c7-5ccd44cbac5f-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:43 devstack sudo[104025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6d658e23-bc7a-4275-8c26-f1022995dda0
Nov 05 10:01:43 devstack sudo[104025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-83b712da-69e6-4dbf-9dc6-8436e5703030 tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "cinder-e4f26208-8ea2-4f01-94c7-5ccd44cbac5f-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-83b712da-69e6-4dbf-9dc6-8436e5703030 tempest-CreateVolumesFromSnapshotTest-745460845 None] Acquiring lock "cinder-quobyte-e4f26208-8ea2-4f01-94c7-5ccd44cbac5f" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-83b712da-69e6-4dbf-9dc6-8436e5703030 tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "cinder-quobyte-e4f26208-8ea2-4f01-94c7-5ccd44cbac5f" acquired by "delete_volume" :: waited 0.039s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:43 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5d7846-1281-49d3-8a6e-a2c0e86794b2]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:01:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-83b712da-69e6-4dbf-9dc6-8436e5703030 tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e4f26208-8ea2-4f01-94c7-5ccd44cbac5f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:43 devstack sudo[104025]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-08e16926-8472-4812-8cf6-b230c957bff2 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6d658e23-bc7a-4275-8c26-f1022995dda0" returned: 0 in 0.463s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-08e16926-8472-4812-8cf6-b230c957bff2 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6d658e23-bc7a-4275-8c26-f1022995dda0 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:43 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e2a3d12f-e696-404d-b1cb-97eecbb5ca0c tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.457s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:44 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-e2a3d12f-e696-404d-b1cb-97eecbb5ca0c tempest-CreateVolumesFromSnapshotTest-745460845 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:01:44 devstack sudo[104029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e4f26208-8ea2-4f01-94c7-5ccd44cbac5f
Nov 05 10:01:44 devstack sudo[104034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6d658e23-bc7a-4275-8c26-f1022995dda0
Nov 05 10:01:44 devstack sudo[104029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:44 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:44 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-e2a3d12f-e696-404d-b1cb-97eecbb5ca0c tempest-CreateVolumesFromSnapshotTest-745460845 None] Deleted volume successfully.
Nov 05 10:01:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-e2a3d12f-e696-404d-b1cb-97eecbb5ca0c tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "cinder-25459d8d-fa31-4e6d-9875-af6120698f59-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:44 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-08e16926-8472-4812-8cf6-b230c957bff2 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-6d658e23-bc7a-4275-8c26-f1022995dda0" returned: 0 in 0.335s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:44 devstack sudo[104029]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-83b712da-69e6-4dbf-9dc6-8436e5703030 tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e4f26208-8ea2-4f01-94c7-5ccd44cbac5f" returned: 0 in 0.483s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-83b712da-69e6-4dbf-9dc6-8436e5703030 tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e4f26208-8ea2-4f01-94c7-5ccd44cbac5f {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-08e16926-8472-4812-8cf6-b230c957bff2 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "cinder-quobyte-6d658e23-bc7a-4275-8c26-f1022995dda0" released by "delete_volume" :: held 0.871s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:44 devstack sudo[104041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e4f26208-8ea2-4f01-94c7-5ccd44cbac5f
Nov 05 10:01:44 devstack sudo[104041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:44 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-08e16926-8472-4812-8cf6-b230c957bff2 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Created reservations ['66cf8699-d114-441c-b5f2-2070529d3210', 'bf419a44-3fd7-4af1-8456-513d349343b3', '12430ea0-e8cd-4157-9dfb-a74a7e6d5755', '2d17fb1e-0f28-4ff3-8cf2-249c71a1cad5'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:01:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-08e16926-8472-4812-8cf6-b230c957bff2 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-08e16926-8472-4812-8cf6-b230c957bff2 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-08e16926-8472-4812-8cf6-b230c957bff2 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-08e16926-8472-4812-8cf6-b230c957bff2 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-08e16926-8472-4812-8cf6-b230c957bff2 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-08e16926-8472-4812-8cf6-b230c957bff2 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:44 devstack sudo[104043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:01:44 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:44 devstack sudo[104041]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-83b712da-69e6-4dbf-9dc6-8436e5703030 tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e4f26208-8ea2-4f01-94c7-5ccd44cbac5f" returned: 0 in 0.376s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-83b712da-69e6-4dbf-9dc6-8436e5703030 tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "cinder-quobyte-e4f26208-8ea2-4f01-94c7-5ccd44cbac5f" released by "delete_volume" :: held 0.938s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:44 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-83b712da-69e6-4dbf-9dc6-8436e5703030 tempest-CreateVolumesFromSnapshotTest-745460845 None] Created reservations ['58812488-b62d-45f5-be83-4a2441cd7dac', '1ba583b4-0717-4e87-b1d4-c8f83f910cdd', '7766393f-f217-488c-8387-cbf19e5358d9', '4874b9e0-5956-49db-b1f0-4580b71215a0'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:01:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-83b712da-69e6-4dbf-9dc6-8436e5703030 tempest-CreateVolumesFromSnapshotTest-745460845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-83b712da-69e6-4dbf-9dc6-8436e5703030 tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-83b712da-69e6-4dbf-9dc6-8436e5703030 tempest-CreateVolumesFromSnapshotTest-745460845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-83b712da-69e6-4dbf-9dc6-8436e5703030 tempest-CreateVolumesFromSnapshotTest-745460845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-83b712da-69e6-4dbf-9dc6-8436e5703030 tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-83b712da-69e6-4dbf-9dc6-8436e5703030 tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:44 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-08e16926-8472-4812-8cf6-b230c957bff2 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.389s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:44 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-08e16926-8472-4812-8cf6-b230c957bff2 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:01:44 devstack sudo[104047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:01:44 devstack sudo[104047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:44 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-08e16926-8472-4812-8cf6-b230c957bff2 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Deleted volume successfully.
Nov 05 10:01:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cbfb9d4a-5e16-433d-ad01-6352a330aa7b tempest-CreateVolumesFromSnapshotTest-745460845 None] Acquiring lock "cinder-c4d2ff95-0329-469c-be78-0e4362ae7c25-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-08e16926-8472-4812-8cf6-b230c957bff2 tempest-CreateVolumesFromSourceVolumeTest-1322803300 None] Lock "cinder-6d658e23-bc7a-4275-8c26-f1022995dda0-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cbfb9d4a-5e16-433d-ad01-6352a330aa7b tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "cinder-c4d2ff95-0329-469c-be78-0e4362ae7c25-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cbfb9d4a-5e16-433d-ad01-6352a330aa7b tempest-CreateVolumesFromSnapshotTest-745460845 None] Acquiring lock "cinder-quobyte-c4d2ff95-0329-469c-be78-0e4362ae7c25" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cbfb9d4a-5e16-433d-ad01-6352a330aa7b tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "cinder-quobyte-c4d2ff95-0329-469c-be78-0e4362ae7c25" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:45 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[504a9312-2b91-40fd-b70c-138622d59107]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:01:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cbfb9d4a-5e16-433d-ad01-6352a330aa7b tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4d2ff95-0329-469c-be78-0e4362ae7c25 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:45 devstack sudo[104047]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-83b712da-69e6-4dbf-9dc6-8436e5703030 tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.300s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:45 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-83b712da-69e6-4dbf-9dc6-8436e5703030 tempest-CreateVolumesFromSnapshotTest-745460845 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:01:45 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-83b712da-69e6-4dbf-9dc6-8436e5703030 tempest-CreateVolumesFromSnapshotTest-745460845 None] Deleted volume successfully.
Nov 05 10:01:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-83b712da-69e6-4dbf-9dc6-8436e5703030 tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "cinder-e4f26208-8ea2-4f01-94c7-5ccd44cbac5f-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:45 devstack sudo[104050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4d2ff95-0329-469c-be78-0e4362ae7c25
Nov 05 10:01:45 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:45 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cbfb9d4a-5e16-433d-ad01-6352a330aa7b tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4d2ff95-0329-469c-be78-0e4362ae7c25" returned: 0 in 0.444s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cbfb9d4a-5e16-433d-ad01-6352a330aa7b tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4d2ff95-0329-469c-be78-0e4362ae7c25 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:45 devstack sudo[104055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4d2ff95-0329-469c-be78-0e4362ae7c25
Nov 05 10:01:45 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:45 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cbfb9d4a-5e16-433d-ad01-6352a330aa7b tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c4d2ff95-0329-469c-be78-0e4362ae7c25" returned: 0 in 0.290s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cbfb9d4a-5e16-433d-ad01-6352a330aa7b tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "cinder-quobyte-c4d2ff95-0329-469c-be78-0e4362ae7c25" released by "delete_volume" :: held 0.810s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:46 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-cbfb9d4a-5e16-433d-ad01-6352a330aa7b tempest-CreateVolumesFromSnapshotTest-745460845 None] Created reservations ['c1df34aa-95f2-4a2c-9f4b-12cd1011a3df', 'c4618793-c853-4ad7-9db8-4012046ce627', '69902f91-d2e6-40c7-bba6-5eb506b1f3d0', 'cca262da-4b84-46e2-91a7-c777627b0f37'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:01:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cbfb9d4a-5e16-433d-ad01-6352a330aa7b tempest-CreateVolumesFromSnapshotTest-745460845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cbfb9d4a-5e16-433d-ad01-6352a330aa7b tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-cbfb9d4a-5e16-433d-ad01-6352a330aa7b tempest-CreateVolumesFromSnapshotTest-745460845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-cbfb9d4a-5e16-433d-ad01-6352a330aa7b tempest-CreateVolumesFromSnapshotTest-745460845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cbfb9d4a-5e16-433d-ad01-6352a330aa7b tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cbfb9d4a-5e16-433d-ad01-6352a330aa7b tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:46 devstack sudo[104058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:01:46 devstack sudo[104058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d94af708-035b-4349-b649-de1464f0d828 tempest-CreateVolumesFromSnapshotTest-745460845 None] Acquiring lock "cinder-28aa6776-fbb7-4e65-a3e0-0cb6ebead596-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d94af708-035b-4349-b649-de1464f0d828 tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "cinder-28aa6776-fbb7-4e65-a3e0-0cb6ebead596-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d94af708-035b-4349-b649-de1464f0d828 tempest-CreateVolumesFromSnapshotTest-745460845 None] Acquiring lock "cinder-quobyte-28aa6776-fbb7-4e65-a3e0-0cb6ebead596" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d94af708-035b-4349-b649-de1464f0d828 tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "cinder-quobyte-28aa6776-fbb7-4e65-a3e0-0cb6ebead596" acquired by "delete_volume" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:46 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[2243a461-b3af-4bbe-aa1b-cd724159ed45]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:01:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d94af708-035b-4349-b649-de1464f0d828 tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-28aa6776-fbb7-4e65-a3e0-0cb6ebead596 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:46 devstack sudo[104058]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cbfb9d4a-5e16-433d-ad01-6352a330aa7b tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.327s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:46 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-cbfb9d4a-5e16-433d-ad01-6352a330aa7b tempest-CreateVolumesFromSnapshotTest-745460845 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:01:46 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-cbfb9d4a-5e16-433d-ad01-6352a330aa7b tempest-CreateVolumesFromSnapshotTest-745460845 None] Deleted volume successfully.
Nov 05 10:01:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cbfb9d4a-5e16-433d-ad01-6352a330aa7b tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "cinder-c4d2ff95-0329-469c-be78-0e4362ae7c25-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:46 devstack sudo[104061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-28aa6776-fbb7-4e65-a3e0-0cb6ebead596
Nov 05 10:01:46 devstack sudo[104061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:46 devstack sudo[104061]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d94af708-035b-4349-b649-de1464f0d828 tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-28aa6776-fbb7-4e65-a3e0-0cb6ebead596" returned: 0 in 0.636s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d94af708-035b-4349-b649-de1464f0d828 tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-28aa6776-fbb7-4e65-a3e0-0cb6ebead596 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:47 devstack sudo[104100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-28aa6776-fbb7-4e65-a3e0-0cb6ebead596
Nov 05 10:01:47 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:47 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d94af708-035b-4349-b649-de1464f0d828 tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-28aa6776-fbb7-4e65-a3e0-0cb6ebead596" returned: 0 in 0.374s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d94af708-035b-4349-b649-de1464f0d828 tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "cinder-quobyte-28aa6776-fbb7-4e65-a3e0-0cb6ebead596" released by "delete_volume" :: held 1.081s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:47 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-d94af708-035b-4349-b649-de1464f0d828 tempest-CreateVolumesFromSnapshotTest-745460845 None] Created reservations ['3e64feba-1e48-45b4-88ce-b2056b7d9eaa', '66534805-50ff-46a8-ba8a-b3aef2e3affd', '1bc37132-fc5b-4b45-b2d1-79883b4f7c24', '740af753-2836-49a5-af2e-40d757d968fb'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:01:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d94af708-035b-4349-b649-de1464f0d828 tempest-CreateVolumesFromSnapshotTest-745460845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d94af708-035b-4349-b649-de1464f0d828 tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d94af708-035b-4349-b649-de1464f0d828 tempest-CreateVolumesFromSnapshotTest-745460845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d94af708-035b-4349-b649-de1464f0d828 tempest-CreateVolumesFromSnapshotTest-745460845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d94af708-035b-4349-b649-de1464f0d828 tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d94af708-035b-4349-b649-de1464f0d828 tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:47 devstack sudo[104105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:01:47 devstack sudo[104105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:47 devstack sudo[104105]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d94af708-035b-4349-b649-de1464f0d828 tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.292s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:47 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d94af708-035b-4349-b649-de1464f0d828 tempest-CreateVolumesFromSnapshotTest-745460845 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:01:47 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-d94af708-035b-4349-b649-de1464f0d828 tempest-CreateVolumesFromSnapshotTest-745460845 None] Deleted volume successfully.
Nov 05 10:01:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-d94af708-035b-4349-b649-de1464f0d828 tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "cinder-28aa6776-fbb7-4e65-a3e0-0cb6ebead596-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-debf7458-a398-46d4-8fc7-632d7e94b3ff tempest-CreateVolumesFromSnapshotTest-745460845 None] Acquiring lock "cinder-e854dc33-a81a-4e4e-a5c5-82bb689ef163-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-debf7458-a398-46d4-8fc7-632d7e94b3ff tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "cinder-e854dc33-a81a-4e4e-a5c5-82bb689ef163-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-debf7458-a398-46d4-8fc7-632d7e94b3ff tempest-CreateVolumesFromSnapshotTest-745460845 None] Acquiring lock "cinder-quobyte-1a28508e-a766-486c-a1a4-6492b6c1a05c" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-debf7458-a398-46d4-8fc7-632d7e94b3ff tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "cinder-quobyte-1a28508e-a766-486c-a1a4-6492b6c1a05c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-debf7458-a398-46d4-8fc7-632d7e94b3ff tempest-CreateVolumesFromSnapshotTest-745460845 None] Acquiring lock "cinder-quobyte-e854dc33-a81a-4e4e-a5c5-82bb689ef163" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-debf7458-a398-46d4-8fc7-632d7e94b3ff tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "cinder-quobyte-e854dc33-a81a-4e4e-a5c5-82bb689ef163" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:48 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-debf7458-a398-46d4-8fc7-632d7e94b3ff tempest-CreateVolumesFromSnapshotTest-745460845 None] Deleting offline snapshot e854dc33-a81a-4e4e-a5c5-82bb689ef163 of volume 1a28508e-a766-486c-a1a4-6492b6c1a05c {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 10:01:48 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-debf7458-a398-46d4-8fc7-632d7e94b3ff tempest-CreateVolumesFromSnapshotTest-745460845 None] snapshot_file for this snap is: volume-1a28508e-a766-486c-a1a4-6492b6c1a05c.e854dc33-a81a-4e4e-a5c5-82bb689ef163 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 10:01:48 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf5591e-5244-4b46-9430-96da7ca3b05c]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:01:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-debf7458-a398-46d4-8fc7-632d7e94b3ff tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c.e854dc33-a81a-4e4e-a5c5-82bb689ef163 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:48 devstack sudo[104108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c.e854dc33-a81a-4e4e-a5c5-82bb689ef163
Nov 05 10:01:48 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:49 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-debf7458-a398-46d4-8fc7-632d7e94b3ff tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c.e854dc33-a81a-4e4e-a5c5-82bb689ef163" returned: 0 in 0.444s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-debf7458-a398-46d4-8fc7-632d7e94b3ff tempest-CreateVolumesFromSnapshotTest-745460845 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a28508e-a766-486c-a1a4-6492b6c1a05c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 10:01:49 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[48372b18-4c22-42a7-a24b-65beb86bfa2d]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:01:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-debf7458-a398-46d4-8fc7-632d7e94b3ff tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:49 devstack sudo[104113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c
Nov 05 10:01:49 devstack sudo[104113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:49 devstack sudo[104113]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-debf7458-a398-46d4-8fc7-632d7e94b3ff tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c" returned: 0 in 0.455s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-debf7458-a398-46d4-8fc7-632d7e94b3ff tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c.e854dc33-a81a-4e4e-a5c5-82bb689ef163 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:49 devstack sudo[104118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c.e854dc33-a81a-4e4e-a5c5-82bb689ef163
Nov 05 10:01:49 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:50 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-debf7458-a398-46d4-8fc7-632d7e94b3ff tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c.e854dc33-a81a-4e4e-a5c5-82bb689ef163" returned: 0 in 0.496s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-debf7458-a398-46d4-8fc7-632d7e94b3ff tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c.e854dc33-a81a-4e4e-a5c5-82bb689ef163 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:50 devstack sudo[104125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c.e854dc33-a81a-4e4e-a5c5-82bb689ef163
Nov 05 10:01:50 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:50 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-debf7458-a398-46d4-8fc7-632d7e94b3ff tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c.e854dc33-a81a-4e4e-a5c5-82bb689ef163" returned: 0 in 0.339s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-debf7458-a398-46d4-8fc7-632d7e94b3ff tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "cinder-quobyte-e854dc33-a81a-4e4e-a5c5-82bb689ef163" released by "_delete_snapshot" :: held 1.898s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-debf7458-a398-46d4-8fc7-632d7e94b3ff tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "cinder-quobyte-1a28508e-a766-486c-a1a4-6492b6c1a05c" released by "delete_snapshot" :: held 1.935s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:50 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-debf7458-a398-46d4-8fc7-632d7e94b3ff tempest-CreateVolumesFromSnapshotTest-745460845 None] Created reservations ['f0c6704d-1b12-4a52-931b-f7a998a84025', 'd7c0e0a5-3a57-4bc6-8ab7-1e7712f7402b', '6d9a3b3f-135e-4cc9-af9b-dab4be42ba69', 'ae892383-d970-4dbd-a265-353a959ea4c9'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:01:50 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-debf7458-a398-46d4-8fc7-632d7e94b3ff tempest-CreateVolumesFromSnapshotTest-745460845 None] Delete snapshot completed successfully.
Nov 05 10:01:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-debf7458-a398-46d4-8fc7-632d7e94b3ff tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "cinder-e854dc33-a81a-4e4e-a5c5-82bb689ef163-delete_snapshot" released by "delete_snapshot" :: held 2.198s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-af1631e0-2cc9-4579-b262-164d0e3ce67a tempest-CreateVolumesFromSnapshotTest-745460845 None] Acquiring lock "cinder-1a28508e-a766-486c-a1a4-6492b6c1a05c-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-af1631e0-2cc9-4579-b262-164d0e3ce67a tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "cinder-1a28508e-a766-486c-a1a4-6492b6c1a05c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-af1631e0-2cc9-4579-b262-164d0e3ce67a tempest-CreateVolumesFromSnapshotTest-745460845 None] Acquiring lock "cinder-quobyte-1a28508e-a766-486c-a1a4-6492b6c1a05c" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:01:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-af1631e0-2cc9-4579-b262-164d0e3ce67a tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "cinder-quobyte-1a28508e-a766-486c-a1a4-6492b6c1a05c" acquired by "delete_volume" :: waited 0.030s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:01:50 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc4ad77-746b-4998-981a-3b3df297e09d]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:01:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-af1631e0-2cc9-4579-b262-164d0e3ce67a tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:51 devstack sudo[104128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c
Nov 05 10:01:51 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:51 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-af1631e0-2cc9-4579-b262-164d0e3ce67a tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c" returned: 0 in 0.453s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-af1631e0-2cc9-4579-b262-164d0e3ce67a tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:51 devstack sudo[104133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c
Nov 05 10:01:51 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:51 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-af1631e0-2cc9-4579-b262-164d0e3ce67a tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1a28508e-a766-486c-a1a4-6492b6c1a05c" returned: 0 in 0.263s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-af1631e0-2cc9-4579-b262-164d0e3ce67a tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "cinder-quobyte-1a28508e-a766-486c-a1a4-6492b6c1a05c" released by "delete_volume" :: held 0.812s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:51 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-af1631e0-2cc9-4579-b262-164d0e3ce67a tempest-CreateVolumesFromSnapshotTest-745460845 None] Created reservations ['035c8ad5-6561-41b5-8a1b-e50fb04305de', '1e2c9a53-8a0e-40d1-b8a7-215be98608f9', 'df7c5df1-82b0-4d0e-86c5-0be6e3bcc629', 'cddb6892-fee5-485c-8199-45ea43836a6f'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:01:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-af1631e0-2cc9-4579-b262-164d0e3ce67a tempest-CreateVolumesFromSnapshotTest-745460845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-af1631e0-2cc9-4579-b262-164d0e3ce67a tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:51 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-af1631e0-2cc9-4579-b262-164d0e3ce67a tempest-CreateVolumesFromSnapshotTest-745460845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:51 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-af1631e0-2cc9-4579-b262-164d0e3ce67a tempest-CreateVolumesFromSnapshotTest-745460845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-af1631e0-2cc9-4579-b262-164d0e3ce67a tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-af1631e0-2cc9-4579-b262-164d0e3ce67a tempest-CreateVolumesFromSnapshotTest-745460845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:51 devstack sudo[104136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:01:51 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:52 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-af1631e0-2cc9-4579-b262-164d0e3ce67a tempest-CreateVolumesFromSnapshotTest-745460845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.374s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:52 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-af1631e0-2cc9-4579-b262-164d0e3ce67a tempest-CreateVolumesFromSnapshotTest-745460845 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:01:52 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-af1631e0-2cc9-4579-b262-164d0e3ce67a tempest-CreateVolumesFromSnapshotTest-745460845 None] Deleted volume successfully.
Nov 05 10:01:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-af1631e0-2cc9-4579-b262-164d0e3ce67a tempest-CreateVolumesFromSnapshotTest-745460845 None] Lock "cinder-1a28508e-a766-486c-a1a4-6492b6c1a05c-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:01:53 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:01:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Flow 'volume_create_manager' (b25f31d4-ffba-41ae-bc5e-1b0aae906b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ac8788a-70e4-45de-9d9b-19eb4b5c3382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ac8788a-70e4-45de-9d9b-19eb4b5c3382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2de150ad-8754-4beb-9e19-d7538d2f80ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c42ca2c6a89b46a9a724dbb1b7ffb075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:54Z,use_quota=True,user_id='684eb0048554409a94b47b35a0c304fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1443c9b-6ab2-49d7-a5b2-795dc7d6dd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1443c9b-6ab2-49d7-a5b2-795dc7d6dd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e40c0b76-ff5a-4baf-b026-ce49dfdc43f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:53 devstack cinder-volume[86649]: DEBUG cinder.image.glance [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Creating Keystone auth plugin from conf {{(pid=86649) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 10:01:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e40c0b76-ff5a-4baf-b026-ce49dfdc43f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2de150ad-8754-4beb-9e19-d7538d2f80ab', 'volume_name': 'volume-2de150ad-8754-4beb-9e19-d7538d2f80ab', 'volume_size': 1, 'image_id': '67bc51ef-7b57-43e0-bd8f-c9299471b2b7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/67bc51ef-7b57-43e0-bd8f-c9299471b2b7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f7d67678860b9ea84658bc15b075b0ea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c42ca2c6a89b46a9a724dbb1b7ffb075', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ada68ad98e6a378739bfa7a52320ae10f8fa64c7647e650c1439126a898cdb852d3e2197f929ba3038688c861a32b74343f6f534a82e445d8afa8eedc8c452f4', 'id': '67bc51ef-7b57-43e0-bd8f-c9299471b2b7', 'created_at': datetime.datetime(2026, 11, 5, 9, 1, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 9, 1, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/67bc51ef-7b57-43e0-bd8f-c9299471b2b7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78419c229850>}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d6ee92b-c13e-4d07-9cdb-cdaf246de4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d6ee92b-c13e-4d07-9cdb-cdaf246de4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de14e88d-e488-4fb7-b1eb-90797808c7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:54 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Volume 2de150ad-8754-4beb-9e19-d7538d2f80ab: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2de150ad-8754-4beb-9e19-d7538d2f80ab', 'volume_size': 1, 'image_id': '67bc51ef-7b57-43e0-bd8f-c9299471b2b7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/67bc51ef-7b57-43e0-bd8f-c9299471b2b7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f7d67678860b9ea84658bc15b075b0ea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c42ca2c6a89b46a9a724dbb1b7ffb075', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ada68ad98e6a378739bfa7a52320ae10f8fa64c7647e650c1439126a898cdb852d3e2197f929ba3038688c861a32b74343f6f534a82e445d8afa8eedc8c452f4', 'id': '67bc51ef-7b57-43e0-bd8f-c9299471b2b7', 'created_at': datetime.datetime(2026, 11, 5, 9, 1, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 9, 1, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/67bc51ef-7b57-43e0-bd8f-c9299471b2b7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78419c229850>}
Nov 05 10:01:54 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Trying to clone 2de150ad-8754-4beb-9e19-d7538d2f80ab from image 67bc51ef-7b57-43e0-bd8f-c9299471b2b7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/67bc51ef-7b57-43e0-bd8f-c9299471b2b7', 'metadata': {}}]). {{(pid=86649) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 10:01:54 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_67bc51ef-7b57-43e0-bd8f-c9299471b2b7_4daggb9jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 10:01:54 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 10:01:54 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d38327f-f465-46e6-bf77-7d973696d55b]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:01:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_67bc51ef-7b57-43e0-bd8f-c9299471b2b7_4daggb9jdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:54 devstack sudo[104139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_67bc51ef-7b57-43e0-bd8f-c9299471b2b7_4daggb9jdevstack@QuobyteHD
Nov 05 10:01:54 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:54 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_67bc51ef-7b57-43e0-bd8f-c9299471b2b7_4daggb9jdevstack@QuobyteHD" returned: 0 in 0.447s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67bc51ef-7b57-43e0-bd8f-c9299471b2b7_4daggb9jdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:55 devstack sudo[104143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67bc51ef-7b57-43e0-bd8f-c9299471b2b7_4daggb9jdevstack@QuobyteHD
Nov 05 10:01:55 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:55 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67bc51ef-7b57-43e0-bd8f-c9299471b2b7_4daggb9jdevstack@QuobyteHD" returned: 1 in 0.362s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67bc51ef-7b57-43e0-bd8f-c9299471b2b7_4daggb9jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 10:01:55 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Temporary image 67bc51ef-7b57-43e0-bd8f-c9299471b2b7 is fetched for user 684eb0048554409a94b47b35a0c304fa. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 10:01:55 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4680f3-aeed-4e3b-a512-bc054906000f]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:01:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_67bc51ef-7b57-43e0-bd8f-c9299471b2b7_4daggb9jdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:55 devstack sudo[104148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_67bc51ef-7b57-43e0-bd8f-c9299471b2b7_4daggb9jdevstack@QuobyteHD
Nov 05 10:01:55 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:55 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_67bc51ef-7b57-43e0-bd8f-c9299471b2b7_4daggb9jdevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67bc51ef-7b57-43e0-bd8f-c9299471b2b7_4daggb9jdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:55 devstack sudo[104152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67bc51ef-7b57-43e0-bd8f-c9299471b2b7_4daggb9jdevstack@QuobyteHD
Nov 05 10:01:55 devstack sudo[104152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:56 devstack sudo[104152]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67bc51ef-7b57-43e0-bd8f-c9299471b2b7_4daggb9jdevstack@QuobyteHD" returned: 1 in 0.342s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67bc51ef-7b57-43e0-bd8f-c9299471b2b7_4daggb9jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 10:01:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2de150ad-8754-4beb-9e19-d7538d2f80ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c42ca2c6a89b46a9a724dbb1b7ffb075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:54Z,use_quota=True,user_id='684eb0048554409a94b47b35a0c304fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:01:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Creating volume 2de150ad-8754-4beb-9e19-d7538d2f80ab {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:01:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:01:56 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:01:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2de150ad-8754-4beb-9e19-d7538d2f80ab 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:56 devstack sudo[104157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2de150ad-8754-4beb-9e19-d7538d2f80ab 1073741824
Nov 05 10:01:56 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:56 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:01:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] Flow 'volume_create_manager' (9ed1ef82-8589-4649-8f12-161913d6617a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78e9b169-1963-477a-85ca-cbc1cfc91910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78e9b169-1963-477a-85ca-cbc1cfc91910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-71229039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27dbbf58-ee30-4d5d-b190-76f84505e1f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fb4fcc8aafe443387cd2e16458f2a07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:57Z,use_quota=True,user_id='9c6eb487d57e42359ba97a14bccb8dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a357a9a-b94e-4e1e-be5c-886485b26f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:56 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a357a9a-b94e-4e1e-be5c-886485b26f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a09850-543c-4ef4-b566-f0793518b832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a09850-543c-4ef4-b566-f0793518b832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27dbbf58-ee30-4d5d-b190-76f84505e1f1', 'volume_name': 'volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99bb860b-1a66-4255-a122-11fb73e909e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99bb860b-1a66-4255-a122-11fb73e909e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48a60e44-1cf6-4de9-b9e7-54c2a533ed5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:56 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] Volume 27dbbf58-ee30-4d5d-b190-76f84505e1f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1', 'volume_size': 1}
Nov 05 10:01:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2de150ad-8754-4beb-9e19-d7538d2f80ab 1073741824" returned: 0 in 0.720s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2de150ad-8754-4beb-9e19-d7538d2f80ab {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:56 devstack sudo[104163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2de150ad-8754-4beb-9e19-d7538d2f80ab
Nov 05 10:01:56 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:57 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2de150ad-8754-4beb-9e19-d7538d2f80ab" returned: 0 in 0.293s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:01:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.343s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-71229039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27dbbf58-ee30-4d5d-b190-76f84505e1f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fb4fcc8aafe443387cd2e16458f2a07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:01:57Z,use_quota=True,user_id='9c6eb487d57e42359ba97a14bccb8dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:01:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] Creating volume 27dbbf58-ee30-4d5d-b190-76f84505e1f1 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:01:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:01:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:01:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:57 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:01:57 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:01:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:57 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Attempting download of 67bc51ef-7b57-43e0-bd8f-c9299471b2b7 ((None, [{'url': 'file:///opt/stack/data/glance/images/67bc51ef-7b57-43e0-bd8f-c9299471b2b7', 'metadata': {}}])) to volume 2de150ad-8754-4beb-9e19-d7538d2f80ab. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 10:01:57 devstack sudo[104166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1 1073741824
Nov 05 10:01:57 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:57 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[1417caec-c909-4cd3-bafa-f4bc36083691]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:01:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_67bc51ef-7b57-43e0-bd8f-c9299471b2b7_4dznbnia {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:57 devstack sudo[104168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_67bc51ef-7b57-43e0-bd8f-c9299471b2b7_4dznbnia
Nov 05 10:01:57 devstack sudo[104168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:57 devstack sudo[104168]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_67bc51ef-7b57-43e0-bd8f-c9299471b2b7_4dznbnia" returned: 0 in 0.531s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_67bc51ef-7b57-43e0-bd8f-c9299471b2b7_4dznbnia {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:57 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1 1073741824" returned: 0 in 0.673s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:57 devstack sudo[104177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1
Nov 05 10:01:57 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:58 devstack sudo[104176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_67bc51ef-7b57-43e0-bd8f-c9299471b2b7_4dznbnia
Nov 05 10:01:58 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:58 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1" returned: 0 in 0.346s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:01:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:01:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48a60e44-1cf6-4de9-b9e7-54c2a533ed5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de7197df-4073-47ab-92e8-280253971931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:01:58 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_67bc51ef-7b57-43e0-bd8f-c9299471b2b7_4dznbnia" returned: 1 in 0.444s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_67bc51ef-7b57-43e0-bd8f-c9299471b2b7_4dznbnia' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 10:01:58 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] Volume volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1 (27dbbf58-ee30-4d5d-b190-76f84505e1f1): created successfully
Nov 05 10:01:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de7197df-4073-47ab-92e8-280253971931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:01:58 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] Flow 'volume_create_manager' (9ed1ef82-8589-4649-8f12-161913d6617a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:01:58 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[707afe47-6116-4d2e-aaf8-a859cd9015bc]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:01:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_67bc51ef-7b57-43e0-bd8f-c9299471b2b7_4daggb9jdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:58 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-8866c7c4-a331-44b4-9756-d02c0449635f tempest-VolumeDependencyTests-1338544246 None] Created volume successfully.
Nov 05 10:01:58 devstack sudo[104183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_67bc51ef-7b57-43e0-bd8f-c9299471b2b7_4daggb9jdevstack@QuobyteHD
Nov 05 10:01:58 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:58 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_67bc51ef-7b57-43e0-bd8f-c9299471b2b7_4daggb9jdevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67bc51ef-7b57-43e0-bd8f-c9299471b2b7_4daggb9jdevstack@QuobyteHD {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:58 devstack sudo[104187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67bc51ef-7b57-43e0-bd8f-c9299471b2b7_4daggb9jdevstack@QuobyteHD
Nov 05 10:01:58 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:59 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67bc51ef-7b57-43e0-bd8f-c9299471b2b7_4daggb9jdevstack@QuobyteHD" returned: 1 in 0.476s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67bc51ef-7b57-43e0-bd8f-c9299471b2b7_4daggb9jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 10:01:59 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] 67bc51ef-7b57-43e0-bd8f-c9299471b2b7 was raw, converting to qcow2 {{(pid=86649) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 10:01:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_67bc51ef-7b57-43e0-bd8f-c9299471b2b7_4daggb9jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2de150ad-8754-4beb-9e19-d7538d2f80ab {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:59 devstack sudo[104193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_67bc51ef-7b57-43e0-bd8f-c9299471b2b7_4daggb9jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2de150ad-8754-4beb-9e19-d7538d2f80ab
Nov 05 10:01:59 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-445f60e4-6b89-46fa-b958-460199a91f55 tempest-VolumeDependencyTests-1338544246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:01:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-445f60e4-6b89-46fa-b958-460199a91f55 tempest-VolumeDependencyTests-1338544246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:01:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-445f60e4-6b89-46fa-b958-460199a91f55 tempest-VolumeDependencyTests-1338544246 None] Creating offline snapshot c739cbb8-bf87-46f7-9810-72c3b1202dc4 of volume 27dbbf58-ee30-4d5d-b190-76f84505e1f1 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 10:01:59 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a99178c-3f3c-4163-b86c-3cb553423600]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:01:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-445f60e4-6b89-46fa-b958-460199a91f55 tempest-VolumeDependencyTests-1338544246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:59 devstack sudo[104195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1
Nov 05 10:01:59 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:59 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-445f60e4-6b89-46fa-b958-460199a91f55 tempest-VolumeDependencyTests-1338544246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1" returned: 0 in 0.470s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-445f60e4-6b89-46fa-b958-460199a91f55 tempest-VolumeDependencyTests-1338544246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1.c739cbb8-bf87-46f7-9810-72c3b1202dc4 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:59 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root
Nov 05 10:01:59 devstack sudo[104206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1.c739cbb8-bf87-46f7-9810-72c3b1202dc4 1G
Nov 05 10:01:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_67bc51ef-7b57-43e0-bd8f-c9299471b2b7_4daggb9jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2de150ad-8754-4beb-9e19-d7538d2f80ab" returned: 0 in 0.623s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:01:59 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_67bc51ef-7b57-43e0-bd8f-c9299471b2b7_4daggb9jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2de150ad-8754-4beb-9e19-d7538d2f80ab {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 10:01:59 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 10:01:59 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:01:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2de150ad-8754-4beb-9e19-d7538d2f80ab 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:01:59 devstack sudo[104208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2de150ad-8754-4beb-9e19-d7538d2f80ab 1G
Nov 05 10:01:59 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 10:02:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:00 devstack sudo[104217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:02:00 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:00 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2de150ad-8754-4beb-9e19-d7538d2f80ab 1G" returned: 0 in 0.437s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:00 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Downloaded image 67bc51ef-7b57-43e0-bd8f-c9299471b2b7 ((None, [{'url': 'file:///opt/stack/data/glance/images/67bc51ef-7b57-43e0-bd8f-c9299471b2b7', 'metadata': {}}])) to volume 2de150ad-8754-4beb-9e19-d7538d2f80ab successfully. {{(pid=86649) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 10:02:00 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Temporary image 67bc51ef-7b57-43e0-bd8f-c9299471b2b7 for user 684eb0048554409a94b47b35a0c304fa is deleted. {{(pid=86649) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 10:02:00 devstack cinder-volume[86649]: DEBUG cinder.volume.volume_utils [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Marking volume 2de150ad-8754-4beb-9e19-d7538d2f80ab as bootable. {{(pid=86649) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 10:02:00 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Copying metadata from image 67bc51ef-7b57-43e0-bd8f-c9299471b2b7 to 2de150ad-8754-4beb-9e19-d7538d2f80ab. {{(pid=86649) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 10:02:00 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Creating volume glance metadata for volume 2de150ad-8754-4beb-9e19-d7538d2f80ab backed by image 67bc51ef-7b57-43e0-bd8f-c9299471b2b7 with: {'image_id': '67bc51ef-7b57-43e0-bd8f-c9299471b2b7', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f7d67678860b9ea84658bc15b075b0ea', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86649) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 10:02:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de14e88d-e488-4fb7-b1eb-90797808c7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2de150ad-8754-4beb-9e19-d7538d2f80ab', 'volume_size': 1, 'image_id': '67bc51ef-7b57-43e0-bd8f-c9299471b2b7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/67bc51ef-7b57-43e0-bd8f-c9299471b2b7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f7d67678860b9ea84658bc15b075b0ea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c42ca2c6a89b46a9a724dbb1b7ffb075', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ada68ad98e6a378739bfa7a52320ae10f8fa64c7647e650c1439126a898cdb852d3e2197f929ba3038688c861a32b74343f6f534a82e445d8afa8eedc8c452f4', 'id': '67bc51ef-7b57-43e0-bd8f-c9299471b2b7', 'created_at': datetime.datetime(2026, 11, 5, 9, 1, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 9, 1, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/67bc51ef-7b57-43e0-bd8f-c9299471b2b7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x78419c229850>}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8de4f1a-aa91-42e9-9976-1293e9df5b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:00 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Volume volume-2de150ad-8754-4beb-9e19-d7538d2f80ab (2de150ad-8754-4beb-9e19-d7538d2f80ab): created successfully
Nov 05 10:02:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8de4f1a-aa91-42e9-9976-1293e9df5b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Flow 'volume_create_manager' (b25f31d4-ffba-41ae-bc5e-1b0aae906b74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:00 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-445f60e4-6b89-46fa-b958-460199a91f55 tempest-VolumeDependencyTests-1338544246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1.c739cbb8-bf87-46f7-9810-72c3b1202dc4 1G" returned: 0 in 0.675s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-445f60e4-6b89-46fa-b958-460199a91f55 tempest-VolumeDependencyTests-1338544246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1.c739cbb8-bf87-46f7-9810-72c3b1202dc4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:00 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-7d12a88d-9204-46a9-977c-8d30d17c0ace tempest-VolumeImageDependencyTests-470712080 None] Created volume successfully.
Nov 05 10:02:00 devstack sudo[104220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1.c739cbb8-bf87-46f7-9810-72c3b1202dc4
Nov 05 10:02:00 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:00 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.453s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:02:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 10:02:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 28 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 10:02:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>, <Thread(tpool_thread_0, started daemon 132223357408960)>, <Thread(tpool_thread_1, started daemon 132223349016256)>, <Thread(tpool_thread_2, started daemon 132223340623552)>, <Thread(tpool_thread_3, started daemon 132223332230848)>, <Thread(tpool_thread_4, started daemon 132223323838144)>, <Thread(tpool_thread_5, started daemon 132223315445440)>, <Thread(tpool_thread_6, started daemon 132223307052736)>, <Thread(tpool_thread_7, started daemon 132223298660032)>, <Thread(tpool_thread_8, started daemon 132223290250944)>, <Thread(tpool_thread_9, started daemon 132223281841856)>, <Thread(tpool_thread_10, started daemon 132223273432768)>, <Thread(tpool_thread_11, started daemon 132223265023680)>, <Thread(tpool_thread_12, started daemon 132223256614592)>, <Thread(tpool_thread_13, started daemon 132223248205504)>, <Thread(tpool_thread_14, started daemon 132223239796416)>, <Thread(tpool_thread_15, started daemon 132223231387328)>, <Thread(tpool_thread_16, started daemon 132223222978240)>, <Thread(tpool_thread_17, started daemon 132223214569152)>, <Thread(tpool_thread_18, started daemon 132223206160064)>, <Thread(tpool_thread_19, started daemon 132223197750976)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 10:02:00 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-445f60e4-6b89-46fa-b958-460199a91f55 tempest-VolumeDependencyTests-1338544246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1.c739cbb8-bf87-46f7-9810-72c3b1202dc4" returned: 0 in 0.439s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:00 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-445f60e4-6b89-46fa-b958-460199a91f55 tempest-VolumeDependencyTests-1338544246 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1.c739cbb8-bf87-46f7-9810-72c3b1202dc4 is being set with open permissions: ugo+rw
Nov 05 10:02:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-445f60e4-6b89-46fa-b958-460199a91f55 tempest-VolumeDependencyTests-1338544246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1.c739cbb8-bf87-46f7-9810-72c3b1202dc4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:00 devstack sudo[104226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1.c739cbb8-bf87-46f7-9810-72c3b1202dc4
Nov 05 10:02:00 devstack sudo[104226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:01 devstack sudo[104226]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-445f60e4-6b89-46fa-b958-460199a91f55 tempest-VolumeDependencyTests-1338544246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1.c739cbb8-bf87-46f7-9810-72c3b1202dc4" returned: 0 in 0.286s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-445f60e4-6b89-46fa-b958-460199a91f55 tempest-VolumeDependencyTests-1338544246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-570e19bb-c2cd-46c5-a02c-8d2b5666fce7 tempest-VolumeImageDependencyTests-470712080 None] Acquiring lock "cinder-2de150ad-8754-4beb-9e19-d7538d2f80ab-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:01 devstack sudo[104229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1.info
Nov 05 10:02:01 devstack sudo[104229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-570e19bb-c2cd-46c5-a02c-8d2b5666fce7 tempest-VolumeImageDependencyTests-470712080 None] Lock "cinder-2de150ad-8754-4beb-9e19-d7538d2f80ab-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-570e19bb-c2cd-46c5-a02c-8d2b5666fce7 tempest-VolumeImageDependencyTests-470712080 None] Acquiring lock "cinder-quobyte-2de150ad-8754-4beb-9e19-d7538d2f80ab" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-570e19bb-c2cd-46c5-a02c-8d2b5666fce7 tempest-VolumeImageDependencyTests-470712080 None] Lock "cinder-quobyte-2de150ad-8754-4beb-9e19-d7538d2f80ab" acquired by "delete_volume" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:01 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad0890f-318a-46af-8a4e-f16d3d07be64]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-570e19bb-c2cd-46c5-a02c-8d2b5666fce7 tempest-VolumeImageDependencyTests-470712080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2de150ad-8754-4beb-9e19-d7538d2f80ab {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:01 devstack sudo[104231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2de150ad-8754-4beb-9e19-d7538d2f80ab
Nov 05 10:02:01 devstack sudo[104231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:01 devstack sudo[104229]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-445f60e4-6b89-46fa-b958-460199a91f55 tempest-VolumeDependencyTests-1338544246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1.info" returned: 0 in 0.335s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:01 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-445f60e4-6b89-46fa-b958-460199a91f55 tempest-VolumeDependencyTests-1338544246 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1.info is being set with open permissions: ugo+rw
Nov 05 10:02:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-445f60e4-6b89-46fa-b958-460199a91f55 tempest-VolumeDependencyTests-1338544246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:01 devstack sudo[104234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1.info
Nov 05 10:02:01 devstack sudo[104234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:01 devstack sudo[104231]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-570e19bb-c2cd-46c5-a02c-8d2b5666fce7 tempest-VolumeImageDependencyTests-470712080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2de150ad-8754-4beb-9e19-d7538d2f80ab" returned: 0 in 0.415s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-570e19bb-c2cd-46c5-a02c-8d2b5666fce7 tempest-VolumeImageDependencyTests-470712080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2de150ad-8754-4beb-9e19-d7538d2f80ab {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:01 devstack sudo[104239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2de150ad-8754-4beb-9e19-d7538d2f80ab
Nov 05 10:02:01 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:01 devstack sudo[104234]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-445f60e4-6b89-46fa-b958-460199a91f55 tempest-VolumeDependencyTests-1338544246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1.info" returned: 0 in 0.320s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-445f60e4-6b89-46fa-b958-460199a91f55 tempest-VolumeDependencyTests-1338544246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.666s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:01 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-445f60e4-6b89-46fa-b958-460199a91f55 tempest-VolumeDependencyTests-1338544246 None] Create snapshot completed successfully
Nov 05 10:02:02 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-570e19bb-c2cd-46c5-a02c-8d2b5666fce7 tempest-VolumeImageDependencyTests-470712080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-2de150ad-8754-4beb-9e19-d7538d2f80ab" returned: 0 in 0.339s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-570e19bb-c2cd-46c5-a02c-8d2b5666fce7 tempest-VolumeImageDependencyTests-470712080 None] Lock "cinder-quobyte-2de150ad-8754-4beb-9e19-d7538d2f80ab" released by "delete_volume" :: held 0.816s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:02 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-570e19bb-c2cd-46c5-a02c-8d2b5666fce7 tempest-VolumeImageDependencyTests-470712080 None] Created reservations ['1fded0e3-83ab-411b-b0f2-a6f21c971a21', '3f9e2e1c-a991-4a12-a7d0-4fce12947a85', '37e412e7-2a47-45c3-a396-c9b098000a72', '4a702157-bc6f-4c3b-8a85-e76b09c5ec00'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:02:02 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:02:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] Flow 'volume_create_manager' (bb89231c-2345-4174-bcad-a6d102aa8edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b05f2128-6493-4c53-87f9-23cb81ac18ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b05f2128-6493-4c53-87f9-23cb81ac18ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1457034095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bb40d08-9028-41bf-88c1-403c8ea919ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4c116ececd45e4b5529b715e3cb8f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:02Z,use_quota=True,user_id='0741a898ad034e74aef7144bf4cc9ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae736d9-38f2-476e-8e88-ae330e5439fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae736d9-38f2-476e-8e88-ae330e5439fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3365bfde-3f9e-41c6-89a8-571097469415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3365bfde-3f9e-41c6-89a8-571097469415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bb40d08-9028-41bf-88c1-403c8ea919ad', 'volume_name': 'volume-9bb40d08-9028-41bf-88c1-403c8ea919ad', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a375c0ca-ab7b-4721-b940-f4de5bd8c2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a375c0ca-ab7b-4721-b940-f4de5bd8c2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:02 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad6fe2f-526c-42a5-ac5a-870befc822c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:02 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] Volume 9bb40d08-9028-41bf-88c1-403c8ea919ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bb40d08-9028-41bf-88c1-403c8ea919ad', 'volume_size': 1}
Nov 05 10:02:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1457034095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bb40d08-9028-41bf-88c1-403c8ea919ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4c116ececd45e4b5529b715e3cb8f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:02Z,use_quota=True,user_id='0741a898ad034e74aef7144bf4cc9ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:02:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] Creating volume 9bb40d08-9028-41bf-88c1-403c8ea919ad {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:02:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:02:02 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:02:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-570e19bb-c2cd-46c5-a02c-8d2b5666fce7 tempest-VolumeImageDependencyTests-470712080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-570e19bb-c2cd-46c5-a02c-8d2b5666fce7 tempest-VolumeImageDependencyTests-470712080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-570e19bb-c2cd-46c5-a02c-8d2b5666fce7 tempest-VolumeImageDependencyTests-470712080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:02 devstack sudo[104243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad 1073741824
Nov 05 10:02:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-570e19bb-c2cd-46c5-a02c-8d2b5666fce7 tempest-VolumeImageDependencyTests-470712080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-570e19bb-c2cd-46c5-a02c-8d2b5666fce7 tempest-VolumeImageDependencyTests-470712080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-570e19bb-c2cd-46c5-a02c-8d2b5666fce7 tempest-VolumeImageDependencyTests-470712080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:02 devstack sudo[104243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:02 devstack sudo[104245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:02:02 devstack sudo[104245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:03 devstack sudo[104245]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-570e19bb-c2cd-46c5-a02c-8d2b5666fce7 tempest-VolumeImageDependencyTests-470712080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.505s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-570e19bb-c2cd-46c5-a02c-8d2b5666fce7 tempest-VolumeImageDependencyTests-470712080 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:02:03 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-570e19bb-c2cd-46c5-a02c-8d2b5666fce7 tempest-VolumeImageDependencyTests-470712080 None] Deleted volume successfully.
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-570e19bb-c2cd-46c5-a02c-8d2b5666fce7 tempest-VolumeImageDependencyTests-470712080 None] Lock "cinder-2de150ad-8754-4beb-9e19-d7538d2f80ab-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:03 devstack sudo[104243]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad 1073741824" returned: 0 in 0.677s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:03 devstack sudo[104251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad
Nov 05 10:02:03 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Flow 'volume_create_manager' (e1b02813-9b69-46b1-b09b-a0e80f64847d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8a877a9-33ee-4104-a585-eaef1d9e11a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8a877a9-33ee-4104-a585-eaef1d9e11a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1619198628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c96f9daf-9ec4-450e-b315-ff6bb5cf2109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fb4fcc8aafe443387cd2e16458f2a07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c739cbb8-bf87-46f7-9810-72c3b1202dc4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:03Z,use_quota=True,user_id='9c6eb487d57e42359ba97a14bccb8dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff9c807-60ea-4bb5-bfdd-5307b8e82f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff9c807-60ea-4bb5-bfdd-5307b8e82f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af213e60-de78-42e6-9748-c6542bd1ae93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af213e60-de78-42e6-9748-c6542bd1ae93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c96f9daf-9ec4-450e-b315-ff6bb5cf2109', 'volume_name': 'volume-c96f9daf-9ec4-450e-b315-ff6bb5cf2109', 'volume_size': 1, 'snapshot_id': 'c739cbb8-bf87-46f7-9810-72c3b1202dc4'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e9a42e-55e2-4994-9c33-dec116510e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e9a42e-55e2-4994-9c33-dec116510e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37cd8eec-1711-40db-9278-11fc5e93da8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:03 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Volume c96f9daf-9ec4-450e-b315-ff6bb5cf2109: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c96f9daf-9ec4-450e-b315-ff6bb5cf2109', 'volume_size': 1, 'snapshot_id': 'c739cbb8-bf87-46f7-9810-72c3b1202dc4'}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:03 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad" returned: 0 in 0.330s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.022s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Acquiring lock "cinder-quobyte-c739cbb8-bf87-46f7-9810-72c3b1202dc4-c96f9daf-9ec4-450e-b315-ff6bb5cf2109" by "_create_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad6fe2f-526c-42a5-ac5a-870befc822c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bb40d08-9028-41bf-88c1-403c8ea919ad', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad14de03-4661-449a-b417-18351c8136e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Lock "cinder-quobyte-c739cbb8-bf87-46f7-9810-72c3b1202dc4-c96f9daf-9ec4-450e-b315-ff6bb5cf2109" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Creating volume c96f9daf-9ec4-450e-b315-ff6bb5cf2109 from snapshot c739cbb8-bf87-46f7-9810-72c3b1202dc4 {{(pid=86649) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Acquiring lock "cinder-quobyte-c96f9daf-9ec4-450e-b315-ff6bb5cf2109" by "_copy_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:03 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] Volume volume-9bb40d08-9028-41bf-88c1-403c8ea919ad (9bb40d08-9028-41bf-88c1-403c8ea919ad): created successfully
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad14de03-4661-449a-b417-18351c8136e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] Flow 'volume_create_manager' (bb89231c-2345-4174-bcad-a6d102aa8edf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Lock "cinder-quobyte-c96f9daf-9ec4-450e-b315-ff6bb5cf2109" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] snapshot: c739cbb8-bf87-46f7-9810-72c3b1202dc4, volume: c96f9daf-9ec4-450e-b315-ff6bb5cf2109,  {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:03 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-aa7440bd-26ed-4d0d-8d5f-9560b438ef62 tempest-ProjectReaderTests-1925760580 None] Created volume successfully.
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60a116c-42eb-46d0-8eae-614cd1652fa0]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1.c739cbb8-bf87-46f7-9810-72c3b1202dc4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:03 devstack sudo[104254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1.c739cbb8-bf87-46f7-9810-72c3b1202dc4
Nov 05 10:02:03 devstack sudo[104254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:04 devstack sudo[104254]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1.c739cbb8-bf87-46f7-9810-72c3b1202dc4" returned: 0 in 0.451s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 10:02:04 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6234300-03d5-438e-9e7a-16703efa4dc0]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:04 devstack sudo[104259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1
Nov 05 10:02:04 devstack sudo[104259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:04 devstack sudo[104259]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1" returned: 0 in 0.456s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1 {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 10:02:04 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Creating direct copy from snapshot {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 10:02:04 devstack cinder-volume[86649]: DEBUG cinder.utils [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Path /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c96f9daf-9ec4-450e-b315-ff6bb5cf2109 not found in is_blk_device check {{(pid=86649) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 10:02:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c96f9daf-9ec4-450e-b315-ff6bb5cf2109 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:04 devstack sudo[104264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c96f9daf-9ec4-450e-b315-ff6bb5cf2109
Nov 05 10:02:04 devstack sudo[104264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9acdadda-2851-4c00-b9a9-3c387d3aa372 tempest-ProjectReaderTests-1925760580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:08 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:02:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] Flow 'volume_create_manager' (ae99afeb-9420-4c7e-94eb-ddc0ef966435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43ba36c-bfd3-4af9-a949-be3734ec901a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43ba36c-bfd3-4af9-a949-be3734ec901a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eda45f24-920c-49ca-a46b-5da21cfa8eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b0ebdcaf0ae4ae18cb9025f27c7a725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:08Z,use_quota=True,user_id='f1865f651912424abc5ebf3fab89eac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27ca6de1-682c-4320-a0bf-0d2887fc907d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27ca6de1-682c-4320-a0bf-0d2887fc907d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c60b2d-6c22-4afc-ad2e-73a06be8521e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c60b2d-6c22-4afc-ad2e-73a06be8521e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eda45f24-920c-49ca-a46b-5da21cfa8eca', 'volume_name': 'volume-eda45f24-920c-49ca-a46b-5da21cfa8eca', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d463ad7f-6fd1-4f03-a042-994ffcb642d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d463ad7f-6fd1-4f03-a042-994ffcb642d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (686186fc-e58f-46d5-a9bf-d5a37e93c8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:08 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] Volume eda45f24-920c-49ca-a46b-5da21cfa8eca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eda45f24-920c-49ca-a46b-5da21cfa8eca', 'volume_size': 1}
Nov 05 10:02:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:11 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:02:11 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] Flow 'volume_create_manager' (28acb77e-770f-4c84-8d3c-ecf890424070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:11 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82fe2791-1abc-474a-b722-4c343a5231ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:11 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82fe2791-1abc-474a-b722-4c343a5231ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1975791658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dba0785b-2883-4666-bdd4-076b4e048da9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cdf5343ab284123a6b4428c20259f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:11Z,use_quota=True,user_id='d7bbab2d671e4c3c9b059abc2e317fd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:11 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ab5c50e-085a-4591-9bbf-05ce39b9b464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:11 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ab5c50e-085a-4591-9bbf-05ce39b9b464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:11 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4a26f37-f0ce-4ef1-99f9-adf77dcd6673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:11 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4a26f37-f0ce-4ef1-99f9-adf77dcd6673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dba0785b-2883-4666-bdd4-076b4e048da9', 'volume_name': 'volume-dba0785b-2883-4666-bdd4-076b4e048da9', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:11 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faabd328-a18b-455e-9f51-3aec7cacafc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:11 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faabd328-a18b-455e-9f51-3aec7cacafc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:11 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9818f5a4-1b70-4608-81e3-a5d35a5749bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:11 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] Volume dba0785b-2883-4666-bdd4-076b4e048da9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dba0785b-2883-4666-bdd4-076b4e048da9', 'volume_size': 1}
Nov 05 10:02:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:12 devstack sudo[104264]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c96f9daf-9ec4-450e-b315-ff6bb5cf2109" returned: 0 in 7.749s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:12 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Image conversion details: src /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1, size 1024.00 MB, duration 7.75 sec, destination /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c96f9daf-9ec4-450e-b315-ff6bb5cf2109 {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 10:02:12 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Converted 1024.00 MB image at 132.13 MB/s
Nov 05 10:02:12 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c96f9daf-9ec4-450e-b315-ff6bb5cf2109 is being set with open permissions: ugo+rw
Nov 05 10:02:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c96f9daf-9ec4-450e-b315-ff6bb5cf2109 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:12 devstack sudo[104278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c96f9daf-9ec4-450e-b315-ff6bb5cf2109
Nov 05 10:02:12 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:12 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c96f9daf-9ec4-450e-b315-ff6bb5cf2109" returned: 0 in 0.252s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Lock "cinder-quobyte-c96f9daf-9ec4-450e-b315-ff6bb5cf2109" released by "_copy_volume_from_snapshot" :: held 9.042s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Lock "cinder-quobyte-c739cbb8-bf87-46f7-9810-72c3b1202dc4-c96f9daf-9ec4-450e-b315-ff6bb5cf2109" released by "_create_volume_from_snapshot" :: held 9.127s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.161s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9acdadda-2851-4c00-b9a9-3c387d3aa372 tempest-ProjectReaderTests-1925760580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.808s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-9acdadda-2851-4c00-b9a9-3c387d3aa372 tempest-ProjectReaderTests-1925760580 None] Creating offline snapshot 57d0404e-604f-48bf-8810-a247c91b226e of volume 9bb40d08-9028-41bf-88c1-403c8ea919ad {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 10:02:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37cd8eec-1711-40db-9278-11fc5e93da8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c96f9daf-9ec4-450e-b315-ff6bb5cf2109', 'volume_size': 1, 'snapshot_id': 'c739cbb8-bf87-46f7-9810-72c3b1202dc4'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b30ec79d-7856-41c0-968b-ab2de02b247e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:12 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f08432a-28cb-4867-a5fb-1c1153e4ae4a]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9acdadda-2851-4c00-b9a9-3c387d3aa372 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:12 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Volume volume-c96f9daf-9ec4-450e-b315-ff6bb5cf2109 (c96f9daf-9ec4-450e-b315-ff6bb5cf2109): created successfully
Nov 05 10:02:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b30ec79d-7856-41c0-968b-ab2de02b247e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:12 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Flow 'volume_create_manager' (e1b02813-9b69-46b1-b09b-a0e80f64847d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:12 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-88167ed7-e557-461c-9362-a4af7b753993 tempest-VolumeDependencyTests-1338544246 None] Created volume successfully.
Nov 05 10:02:12 devstack sudo[104281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad
Nov 05 10:02:12 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-80759815-bf8f-48a2-8460-bc128dad7e65 tempest-VolumeDependencyTests-1338544246 None] Acquiring lock "cinder-c739cbb8-bf87-46f7-9810-72c3b1202dc4-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-80759815-bf8f-48a2-8460-bc128dad7e65 tempest-VolumeDependencyTests-1338544246 None] Lock "cinder-c739cbb8-bf87-46f7-9810-72c3b1202dc4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-80759815-bf8f-48a2-8460-bc128dad7e65 tempest-VolumeDependencyTests-1338544246 None] Acquiring lock "cinder-quobyte-27dbbf58-ee30-4d5d-b190-76f84505e1f1" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-80759815-bf8f-48a2-8460-bc128dad7e65 tempest-VolumeDependencyTests-1338544246 None] Lock "cinder-quobyte-27dbbf58-ee30-4d5d-b190-76f84505e1f1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-80759815-bf8f-48a2-8460-bc128dad7e65 tempest-VolumeDependencyTests-1338544246 None] Acquiring lock "cinder-quobyte-c739cbb8-bf87-46f7-9810-72c3b1202dc4" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-80759815-bf8f-48a2-8460-bc128dad7e65 tempest-VolumeDependencyTests-1338544246 None] Lock "cinder-quobyte-c739cbb8-bf87-46f7-9810-72c3b1202dc4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-80759815-bf8f-48a2-8460-bc128dad7e65 tempest-VolumeDependencyTests-1338544246 None] Deleting offline snapshot c739cbb8-bf87-46f7-9810-72c3b1202dc4 of volume 27dbbf58-ee30-4d5d-b190-76f84505e1f1 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 10:02:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-80759815-bf8f-48a2-8460-bc128dad7e65 tempest-VolumeDependencyTests-1338544246 None] snapshot_file for this snap is: volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1.c739cbb8-bf87-46f7-9810-72c3b1202dc4 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 10:02:13 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc04011-9f38-43f2-a206-ee137db66260]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-80759815-bf8f-48a2-8460-bc128dad7e65 tempest-VolumeDependencyTests-1338544246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1.c739cbb8-bf87-46f7-9810-72c3b1202dc4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:13 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9acdadda-2851-4c00-b9a9-3c387d3aa372 tempest-ProjectReaderTests-1925760580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad" returned: 0 in 0.388s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9acdadda-2851-4c00-b9a9-3c387d3aa372 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad.57d0404e-604f-48bf-8810-a247c91b226e 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:13 devstack sudo[104283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1.c739cbb8-bf87-46f7-9810-72c3b1202dc4
Nov 05 10:02:13 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:13 devstack sudo[104288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad.57d0404e-604f-48bf-8810-a247c91b226e 1G
Nov 05 10:02:13 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:13 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-80759815-bf8f-48a2-8460-bc128dad7e65 tempest-VolumeDependencyTests-1338544246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1.c739cbb8-bf87-46f7-9810-72c3b1202dc4" returned: 0 in 0.390s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-80759815-bf8f-48a2-8460-bc128dad7e65 tempest-VolumeDependencyTests-1338544246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 10:02:13 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08d9ceb-3fe6-4e5d-a8ca-85cd617a3c07]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-80759815-bf8f-48a2-8460-bc128dad7e65 tempest-VolumeDependencyTests-1338544246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:13 devstack sudo[104296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1
Nov 05 10:02:13 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:13 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9acdadda-2851-4c00-b9a9-3c387d3aa372 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad.57d0404e-604f-48bf-8810-a247c91b226e 1G" returned: 0 in 0.445s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9acdadda-2851-4c00-b9a9-3c387d3aa372 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bb40d08-9028-41bf-88c1-403c8ea919ad -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad.57d0404e-604f-48bf-8810-a247c91b226e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:13 devstack sudo[104298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bb40d08-9028-41bf-88c1-403c8ea919ad -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad.57d0404e-604f-48bf-8810-a247c91b226e
Nov 05 10:02:13 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:13 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9acdadda-2851-4c00-b9a9-3c387d3aa372 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bb40d08-9028-41bf-88c1-403c8ea919ad -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad.57d0404e-604f-48bf-8810-a247c91b226e" returned: 0 in 0.314s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:13 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-9acdadda-2851-4c00-b9a9-3c387d3aa372 tempest-ProjectReaderTests-1925760580 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad.57d0404e-604f-48bf-8810-a247c91b226e is being set with open permissions: ugo+rw
Nov 05 10:02:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9acdadda-2851-4c00-b9a9-3c387d3aa372 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad.57d0404e-604f-48bf-8810-a247c91b226e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:13 devstack sudo[104305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad.57d0404e-604f-48bf-8810-a247c91b226e
Nov 05 10:02:13 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:13 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-80759815-bf8f-48a2-8460-bc128dad7e65 tempest-VolumeDependencyTests-1338544246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1" returned: 0 in 0.542s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-80759815-bf8f-48a2-8460-bc128dad7e65 tempest-VolumeDependencyTests-1338544246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1.c739cbb8-bf87-46f7-9810-72c3b1202dc4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:14 devstack sudo[104308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1.c739cbb8-bf87-46f7-9810-72c3b1202dc4
Nov 05 10:02:14 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:14 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9acdadda-2851-4c00-b9a9-3c387d3aa372 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad.57d0404e-604f-48bf-8810-a247c91b226e" returned: 0 in 0.255s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9acdadda-2851-4c00-b9a9-3c387d3aa372 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:14 devstack sudo[104311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad.info
Nov 05 10:02:14 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:14 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-80759815-bf8f-48a2-8460-bc128dad7e65 tempest-VolumeDependencyTests-1338544246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1.c739cbb8-bf87-46f7-9810-72c3b1202dc4" returned: 0 in 0.352s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-80759815-bf8f-48a2-8460-bc128dad7e65 tempest-VolumeDependencyTests-1338544246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1.c739cbb8-bf87-46f7-9810-72c3b1202dc4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:14 devstack sudo[104316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1.c739cbb8-bf87-46f7-9810-72c3b1202dc4
Nov 05 10:02:14 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:14 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9acdadda-2851-4c00-b9a9-3c387d3aa372 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad.info" returned: 0 in 0.266s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:14 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-9acdadda-2851-4c00-b9a9-3c387d3aa372 tempest-ProjectReaderTests-1925760580 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad.info is being set with open permissions: ugo+rw
Nov 05 10:02:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9acdadda-2851-4c00-b9a9-3c387d3aa372 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:14 devstack sudo[104319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad.info
Nov 05 10:02:14 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:14 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-80759815-bf8f-48a2-8460-bc128dad7e65 tempest-VolumeDependencyTests-1338544246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1.c739cbb8-bf87-46f7-9810-72c3b1202dc4" returned: 0 in 0.283s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:14 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-80759815-bf8f-48a2-8460-bc128dad7e65 tempest-VolumeDependencyTests-1338544246 None] Lock "cinder-quobyte-c739cbb8-bf87-46f7-9810-72c3b1202dc4" released by "_delete_snapshot" :: held 1.694s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:14 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-80759815-bf8f-48a2-8460-bc128dad7e65 tempest-VolumeDependencyTests-1338544246 None] Lock "cinder-quobyte-27dbbf58-ee30-4d5d-b190-76f84505e1f1" released by "delete_snapshot" :: held 1.718s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:14 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9acdadda-2851-4c00-b9a9-3c387d3aa372 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad.info" returned: 0 in 0.283s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9acdadda-2851-4c00-b9a9-3c387d3aa372 tempest-ProjectReaderTests-1925760580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.049s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.322s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eda45f24-920c-49ca-a46b-5da21cfa8eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b0ebdcaf0ae4ae18cb9025f27c7a725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:08Z,use_quota=True,user_id='f1865f651912424abc5ebf3fab89eac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:02:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] Creating volume eda45f24-920c-49ca-a46b-5da21cfa8eca {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:02:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:14 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:02:14 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:02:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-eda45f24-920c-49ca-a46b-5da21cfa8eca 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:14 devstack sudo[104323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-eda45f24-920c-49ca-a46b-5da21cfa8eca 1073741824
Nov 05 10:02:14 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:14 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-80759815-bf8f-48a2-8460-bc128dad7e65 tempest-VolumeDependencyTests-1338544246 None] Created reservations ['84299708-dcc4-4141-bd0f-e30fca7dab7d', 'e91ff3b4-75b8-4eca-858c-7dcbecb4ce91', 'cf911b4e-376d-44eb-a63e-002e05f89d35', '44035b86-bd78-408a-9bcb-ca70d16bf686'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:02:14 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-9acdadda-2851-4c00-b9a9-3c387d3aa372 tempest-ProjectReaderTests-1925760580 None] Create snapshot completed successfully
Nov 05 10:02:14 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-80759815-bf8f-48a2-8460-bc128dad7e65 tempest-VolumeDependencyTests-1338544246 None] Delete snapshot completed successfully.
Nov 05 10:02:14 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-80759815-bf8f-48a2-8460-bc128dad7e65 tempest-VolumeDependencyTests-1338544246 None] Lock "cinder-c739cbb8-bf87-46f7-9810-72c3b1202dc4-delete_snapshot" released by "delete_snapshot" :: held 1.932s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a64af52d-e534-424f-b605-b358d7919b8b tempest-VolumeDependencyTests-1338544246 None] Acquiring lock "cinder-27dbbf58-ee30-4d5d-b190-76f84505e1f1-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a64af52d-e534-424f-b605-b358d7919b8b tempest-VolumeDependencyTests-1338544246 None] Lock "cinder-27dbbf58-ee30-4d5d-b190-76f84505e1f1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a64af52d-e534-424f-b605-b358d7919b8b tempest-VolumeDependencyTests-1338544246 None] Acquiring lock "cinder-quobyte-27dbbf58-ee30-4d5d-b190-76f84505e1f1" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a64af52d-e534-424f-b605-b358d7919b8b tempest-VolumeDependencyTests-1338544246 None] Lock "cinder-quobyte-27dbbf58-ee30-4d5d-b190-76f84505e1f1" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[882f943c-3e1e-4e32-8222-bb32801e4b1a]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a64af52d-e534-424f-b605-b358d7919b8b tempest-VolumeDependencyTests-1338544246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:15 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-eda45f24-920c-49ca-a46b-5da21cfa8eca 1073741824" returned: 0 in 0.488s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-eda45f24-920c-49ca-a46b-5da21cfa8eca {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:15 devstack sudo[104330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-eda45f24-920c-49ca-a46b-5da21cfa8eca
Nov 05 10:02:15 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:15 devstack sudo[104329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1
Nov 05 10:02:15 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:15 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-eda45f24-920c-49ca-a46b-5da21cfa8eca" returned: 0 in 0.312s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.936s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1975791658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dba0785b-2883-4666-bdd4-076b4e048da9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cdf5343ab284123a6b4428c20259f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:11Z,use_quota=True,user_id='d7bbab2d671e4c3c9b059abc2e317fd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] Creating volume dba0785b-2883-4666-bdd4-076b4e048da9 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:02:15 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dba0785b-2883-4666-bdd4-076b4e048da9 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:15 devstack sudo[104337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dba0785b-2883-4666-bdd4-076b4e048da9 1073741824
Nov 05 10:02:15 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (686186fc-e58f-46d5-a9bf-d5a37e93c8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eda45f24-920c-49ca-a46b-5da21cfa8eca', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa7de25-d1ec-43f9-b034-f5f400f2ab54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:15 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a64af52d-e534-424f-b605-b358d7919b8b tempest-VolumeDependencyTests-1338544246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1" returned: 0 in 0.480s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a64af52d-e534-424f-b605-b358d7919b8b tempest-VolumeDependencyTests-1338544246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:15 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] Volume volume-eda45f24-920c-49ca-a46b-5da21cfa8eca (eda45f24-920c-49ca-a46b-5da21cfa8eca): created successfully
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa7de25-d1ec-43f9-b034-f5f400f2ab54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] Flow 'volume_create_manager' (ae99afeb-9420-4c7e-94eb-ddc0ef966435) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:15 devstack sudo[104339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1
Nov 05 10:02:15 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:15 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-a7e7f949-91dc-4165-8454-cdd68e9ed781 tempest-CinderUnicodeTest-1762020202 None] Created volume successfully.
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dc0e5090-1245-4255-aee9-931eed86a107 tempest-ProjectReaderTests-1925760580 None] Acquiring lock "cinder-57d0404e-604f-48bf-8810-a247c91b226e-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dc0e5090-1245-4255-aee9-931eed86a107 tempest-ProjectReaderTests-1925760580 None] Lock "cinder-57d0404e-604f-48bf-8810-a247c91b226e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dc0e5090-1245-4255-aee9-931eed86a107 tempest-ProjectReaderTests-1925760580 None] Acquiring lock "cinder-quobyte-9bb40d08-9028-41bf-88c1-403c8ea919ad" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dc0e5090-1245-4255-aee9-931eed86a107 tempest-ProjectReaderTests-1925760580 None] Lock "cinder-quobyte-9bb40d08-9028-41bf-88c1-403c8ea919ad" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dc0e5090-1245-4255-aee9-931eed86a107 tempest-ProjectReaderTests-1925760580 None] Acquiring lock "cinder-quobyte-57d0404e-604f-48bf-8810-a247c91b226e" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dc0e5090-1245-4255-aee9-931eed86a107 tempest-ProjectReaderTests-1925760580 None] Lock "cinder-quobyte-57d0404e-604f-48bf-8810-a247c91b226e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-dc0e5090-1245-4255-aee9-931eed86a107 tempest-ProjectReaderTests-1925760580 None] Deleting offline snapshot 57d0404e-604f-48bf-8810-a247c91b226e of volume 9bb40d08-9028-41bf-88c1-403c8ea919ad {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-dc0e5090-1245-4255-aee9-931eed86a107 tempest-ProjectReaderTests-1925760580 None] snapshot_file for this snap is: volume-9bb40d08-9028-41bf-88c1-403c8ea919ad.57d0404e-604f-48bf-8810-a247c91b226e {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87505f7-1f0a-458e-a26d-07758cbdd493]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dc0e5090-1245-4255-aee9-931eed86a107 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad.57d0404e-604f-48bf-8810-a247c91b226e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:16 devstack sudo[104342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad.57d0404e-604f-48bf-8810-a247c91b226e
Nov 05 10:02:16 devstack sudo[104342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:16 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a64af52d-e534-424f-b605-b358d7919b8b tempest-VolumeDependencyTests-1338544246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-27dbbf58-ee30-4d5d-b190-76f84505e1f1" returned: 0 in 0.333s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:16 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a64af52d-e534-424f-b605-b358d7919b8b tempest-VolumeDependencyTests-1338544246 None] Lock "cinder-quobyte-27dbbf58-ee30-4d5d-b190-76f84505e1f1" released by "delete_volume" :: held 0.881s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:16 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-a64af52d-e534-424f-b605-b358d7919b8b tempest-VolumeDependencyTests-1338544246 None] Created reservations ['1a9ffeaf-4588-4805-a940-a4af551bec4f', '4a4d0a91-8e05-4f1d-af31-f0e1f30a5c7f', '58aa3da5-6e22-48b8-ae8a-68fab6dfa9ca', '79ae3c9f-4a33-4e0d-8b75-dc4334bdc668'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:02:16 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dba0785b-2883-4666-bdd4-076b4e048da9 1073741824" returned: 0 in 0.502s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dba0785b-2883-4666-bdd4-076b4e048da9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a64af52d-e534-424f-b605-b358d7919b8b tempest-VolumeDependencyTests-1338544246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a64af52d-e534-424f-b605-b358d7919b8b tempest-VolumeDependencyTests-1338544246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a64af52d-e534-424f-b605-b358d7919b8b tempest-VolumeDependencyTests-1338544246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:16 devstack sudo[104348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dba0785b-2883-4666-bdd4-076b4e048da9
Nov 05 10:02:16 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a64af52d-e534-424f-b605-b358d7919b8b tempest-VolumeDependencyTests-1338544246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a64af52d-e534-424f-b605-b358d7919b8b tempest-VolumeDependencyTests-1338544246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a64af52d-e534-424f-b605-b358d7919b8b tempest-VolumeDependencyTests-1338544246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:16 devstack sudo[104352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:02:16 devstack sudo[104352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:16 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-11f8eb22-ff05-41b7-917f-f956887a8b6a tempest-VolumeDependencyTests-1338544246 None] Acquiring lock "cinder-c96f9daf-9ec4-450e-b315-ff6bb5cf2109-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:16 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-11f8eb22-ff05-41b7-917f-f956887a8b6a tempest-VolumeDependencyTests-1338544246 None] Lock "cinder-c96f9daf-9ec4-450e-b315-ff6bb5cf2109-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:16 devstack sudo[104342]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:16 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-11f8eb22-ff05-41b7-917f-f956887a8b6a tempest-VolumeDependencyTests-1338544246 None] Acquiring lock "cinder-quobyte-c96f9daf-9ec4-450e-b315-ff6bb5cf2109" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dc0e5090-1245-4255-aee9-931eed86a107 tempest-ProjectReaderTests-1925760580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad.57d0404e-604f-48bf-8810-a247c91b226e" returned: 0 in 0.527s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-dc0e5090-1245-4255-aee9-931eed86a107 tempest-ProjectReaderTests-1925760580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bb40d08-9028-41bf-88c1-403c8ea919ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 10:02:16 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-11f8eb22-ff05-41b7-917f-f956887a8b6a tempest-VolumeDependencyTests-1338544246 None] Lock "cinder-quobyte-c96f9daf-9ec4-450e-b315-ff6bb5cf2109" acquired by "delete_volume" :: waited 0.038s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:16 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af28282-82fa-4927-ae0a-50e09dfca70a]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dc0e5090-1245-4255-aee9-931eed86a107 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:16 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4dd194b-a875-4dad-9659-b16db2a474e0]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11f8eb22-ff05-41b7-917f-f956887a8b6a tempest-VolumeDependencyTests-1338544246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c96f9daf-9ec4-450e-b315-ff6bb5cf2109 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:16 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dba0785b-2883-4666-bdd4-076b4e048da9" returned: 0 in 0.380s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:02:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:16 devstack sudo[104352]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9818f5a4-1b70-4608-81e3-a5d35a5749bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dba0785b-2883-4666-bdd4-076b4e048da9', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8420a6e-c503-435d-86d0-f38a8fddbd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:16 devstack sudo[104355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad
Nov 05 10:02:16 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a64af52d-e534-424f-b605-b358d7919b8b tempest-VolumeDependencyTests-1338544246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.361s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:16 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-a64af52d-e534-424f-b605-b358d7919b8b tempest-VolumeDependencyTests-1338544246 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:02:16 devstack sudo[104356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c96f9daf-9ec4-450e-b315-ff6bb5cf2109
Nov 05 10:02:16 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-a64af52d-e534-424f-b605-b358d7919b8b tempest-VolumeDependencyTests-1338544246 None] Deleted volume successfully.
Nov 05 10:02:16 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:16 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=193,cinder:UPDATE=241,cinder:DELETE=22,cinder:INSERT=73 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 10:02:16 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] Volume volume-dba0785b-2883-4666-bdd4-076b4e048da9 (dba0785b-2883-4666-bdd4-076b4e048da9): created successfully
Nov 05 10:02:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8420a6e-c503-435d-86d0-f38a8fddbd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] Flow 'volume_create_manager' (28acb77e-770f-4c84-8d3c-ecf890424070) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:16 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a64af52d-e534-424f-b605-b358d7919b8b tempest-VolumeDependencyTests-1338544246 None] Lock "cinder-27dbbf58-ee30-4d5d-b190-76f84505e1f1-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:16 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c2cb4521-c987-4a50-bff5-83657c66c790 tempest-ProjectReaderTests-262894575 None] Created volume successfully.
Nov 05 10:02:16 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11f8eb22-ff05-41b7-917f-f956887a8b6a tempest-VolumeDependencyTests-1338544246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c96f9daf-9ec4-450e-b315-ff6bb5cf2109" returned: 0 in 0.480s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11f8eb22-ff05-41b7-917f-f956887a8b6a tempest-VolumeDependencyTests-1338544246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c96f9daf-9ec4-450e-b315-ff6bb5cf2109 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:17 devstack sudo[104368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c96f9daf-9ec4-450e-b315-ff6bb5cf2109
Nov 05 10:02:17 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:17 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dc0e5090-1245-4255-aee9-931eed86a107 tempest-ProjectReaderTests-1925760580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad" returned: 0 in 0.570s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dc0e5090-1245-4255-aee9-931eed86a107 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad.57d0404e-604f-48bf-8810-a247c91b226e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:17 devstack sudo[104370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad.57d0404e-604f-48bf-8810-a247c91b226e
Nov 05 10:02:17 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-986e8522-014f-413b-a35c-6774680b1675 tempest-ProjectReaderTests-262894575 None] Acquiring lock "cinder-dba0785b-2883-4666-bdd4-076b4e048da9-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-986e8522-014f-413b-a35c-6774680b1675 tempest-ProjectReaderTests-262894575 None] Lock "cinder-dba0785b-2883-4666-bdd4-076b4e048da9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=261,cinder:SELECT=173,cinder:INSERT=61,cinder:DELETE=25 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-986e8522-014f-413b-a35c-6774680b1675 tempest-ProjectReaderTests-262894575 None] Acquiring lock "cinder-quobyte-dba0785b-2883-4666-bdd4-076b4e048da9" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-986e8522-014f-413b-a35c-6774680b1675 tempest-ProjectReaderTests-262894575 None] Lock "cinder-quobyte-dba0785b-2883-4666-bdd4-076b4e048da9" acquired by "delete_volume" :: waited 0.029s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac10f6f3-c4ad-4918-8ffd-499484ce9cd2]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-986e8522-014f-413b-a35c-6774680b1675 tempest-ProjectReaderTests-262894575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dba0785b-2883-4666-bdd4-076b4e048da9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:17 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11f8eb22-ff05-41b7-917f-f956887a8b6a tempest-VolumeDependencyTests-1338544246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c96f9daf-9ec4-450e-b315-ff6bb5cf2109" returned: 0 in 0.338s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-11f8eb22-ff05-41b7-917f-f956887a8b6a tempest-VolumeDependencyTests-1338544246 None] Lock "cinder-quobyte-c96f9daf-9ec4-450e-b315-ff6bb5cf2109" released by "delete_volume" :: held 0.889s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-11f8eb22-ff05-41b7-917f-f956887a8b6a tempest-VolumeDependencyTests-1338544246 None] Created reservations ['7be67890-22cd-469d-96bb-a38b4d9fe410', '2a2047e0-cdf6-403a-a288-e93afab97469', '91b32d20-f9ab-467f-a1c3-e586e7e55346', 'ae4966e2-1f64-4bcd-8894-2a358e297ec6'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:02:17 devstack sudo[104373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dba0785b-2883-4666-bdd4-076b4e048da9
Nov 05 10:02:17 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] Flow 'volume_create_manager' (76f7f465-6f19-4d0e-b1ed-4a12e61ee065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a55b6a4b-16be-4e2e-a1c5-878a97af8659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a55b6a4b-16be-4e2e-a1c5-878a97af8659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-158208299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d490a3d-b0f9-4671-bea7-d6526f998ab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b0ebdcaf0ae4ae18cb9025f27c7a725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:17Z,use_quota=True,user_id='f1865f651912424abc5ebf3fab89eac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cadb0a9-ea34-42f5-b8cc-ebedfffc2580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cadb0a9-ea34-42f5-b8cc-ebedfffc2580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3d94985-4038-4de2-b5e0-b0340b1fcf3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3d94985-4038-4de2-b5e0-b0340b1fcf3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d490a3d-b0f9-4671-bea7-d6526f998ab4', 'volume_name': 'volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae2c1449-5846-4ac8-a678-0dee73563f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae2c1449-5846-4ac8-a678-0dee73563f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4284830c-0103-42dc-a096-5e29c9fae0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:17 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] Volume 7d490a3d-b0f9-4671-bea7-d6526f998ab4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4', 'volume_size': 1}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-158208299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d490a3d-b0f9-4671-bea7-d6526f998ab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b0ebdcaf0ae4ae18cb9025f27c7a725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:17Z,use_quota=True,user_id='f1865f651912424abc5ebf3fab89eac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] Creating volume 7d490a3d-b0f9-4671-bea7-d6526f998ab4 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:17 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:02:17 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dc0e5090-1245-4255-aee9-931eed86a107 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad.57d0404e-604f-48bf-8810-a247c91b226e" returned: 0 in 0.548s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dc0e5090-1245-4255-aee9-931eed86a107 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad.57d0404e-604f-48bf-8810-a247c91b226e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:17 devstack sudo[104378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4 1073741824
Nov 05 10:02:17 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:17 devstack sudo[104379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad.57d0404e-604f-48bf-8810-a247c91b226e
Nov 05 10:02:17 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-11f8eb22-ff05-41b7-917f-f956887a8b6a tempest-VolumeDependencyTests-1338544246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-11f8eb22-ff05-41b7-917f-f956887a8b6a tempest-VolumeDependencyTests-1338544246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-11f8eb22-ff05-41b7-917f-f956887a8b6a tempest-VolumeDependencyTests-1338544246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-11f8eb22-ff05-41b7-917f-f956887a8b6a tempest-VolumeDependencyTests-1338544246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-11f8eb22-ff05-41b7-917f-f956887a8b6a tempest-VolumeDependencyTests-1338544246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11f8eb22-ff05-41b7-917f-f956887a8b6a tempest-VolumeDependencyTests-1338544246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:17 devstack sudo[104382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:02:17 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:17 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-986e8522-014f-413b-a35c-6774680b1675 tempest-ProjectReaderTests-262894575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dba0785b-2883-4666-bdd4-076b4e048da9" returned: 0 in 0.513s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-986e8522-014f-413b-a35c-6774680b1675 tempest-ProjectReaderTests-262894575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dba0785b-2883-4666-bdd4-076b4e048da9 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:17 devstack sudo[104388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dba0785b-2883-4666-bdd4-076b4e048da9
Nov 05 10:02:17 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:17 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dc0e5090-1245-4255-aee9-931eed86a107 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad.57d0404e-604f-48bf-8810-a247c91b226e" returned: 0 in 0.301s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dc0e5090-1245-4255-aee9-931eed86a107 tempest-ProjectReaderTests-1925760580 None] Lock "cinder-quobyte-57d0404e-604f-48bf-8810-a247c91b226e" released by "_delete_snapshot" :: held 2.077s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dc0e5090-1245-4255-aee9-931eed86a107 tempest-ProjectReaderTests-1925760580 None] Lock "cinder-quobyte-9bb40d08-9028-41bf-88c1-403c8ea919ad" released by "delete_snapshot" :: held 2.108s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:17 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11f8eb22-ff05-41b7-917f-f956887a8b6a tempest-VolumeDependencyTests-1338544246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.342s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:17 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-11f8eb22-ff05-41b7-917f-f956887a8b6a tempest-VolumeDependencyTests-1338544246 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:02:18 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-11f8eb22-ff05-41b7-917f-f956887a8b6a tempest-VolumeDependencyTests-1338544246 None] Deleted volume successfully.
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-dc0e5090-1245-4255-aee9-931eed86a107 tempest-ProjectReaderTests-1925760580 None] Created reservations ['72c3ed2e-5b8f-46c2-bb4d-858b684aa794', 'f2176553-351e-45f7-b4df-78c4a1c2668b', 'c0a23f6c-733c-48a7-b747-3c3784ad587a', '4a3a34b0-09da-4ba1-85b8-920e42bc4a7b'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-11f8eb22-ff05-41b7-917f-f956887a8b6a tempest-VolumeDependencyTests-1338544246 None] Lock "cinder-c96f9daf-9ec4-450e-b315-ff6bb5cf2109-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:18 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-986e8522-014f-413b-a35c-6774680b1675 tempest-ProjectReaderTests-262894575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-dba0785b-2883-4666-bdd4-076b4e048da9" returned: 0 in 0.307s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:18 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-dc0e5090-1245-4255-aee9-931eed86a107 tempest-ProjectReaderTests-1925760580 None] Delete snapshot completed successfully.
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-986e8522-014f-413b-a35c-6774680b1675 tempest-ProjectReaderTests-262894575 None] Lock "cinder-quobyte-dba0785b-2883-4666-bdd4-076b4e048da9" released by "delete_volume" :: held 0.879s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-dc0e5090-1245-4255-aee9-931eed86a107 tempest-ProjectReaderTests-1925760580 None] Lock "cinder-57d0404e-604f-48bf-8810-a247c91b226e-delete_snapshot" released by "delete_snapshot" :: held 2.331s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:18 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4 1073741824" returned: 0 in 0.586s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-986e8522-014f-413b-a35c-6774680b1675 tempest-ProjectReaderTests-262894575 None] Created reservations ['a811a8a3-134a-4712-b2c8-29a1dbbcb3ea', '05bf5262-24ce-4d11-b553-d019de36b0c8', 'c7a76f9b-0a9e-4195-8641-5a043f697b54', '5882d3db-a180-4263-a335-c5ae6b2988e2'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:18 devstack sudo[104397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4
Nov 05 10:02:18 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-986e8522-014f-413b-a35c-6774680b1675 tempest-ProjectReaderTests-262894575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-986e8522-014f-413b-a35c-6774680b1675 tempest-ProjectReaderTests-262894575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-986e8522-014f-413b-a35c-6774680b1675 tempest-ProjectReaderTests-262894575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-986e8522-014f-413b-a35c-6774680b1675 tempest-ProjectReaderTests-262894575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-986e8522-014f-413b-a35c-6774680b1675 tempest-ProjectReaderTests-262894575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-986e8522-014f-413b-a35c-6774680b1675 tempest-ProjectReaderTests-262894575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:18 devstack sudo[104399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:02:18 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:18 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4" returned: 0 in 0.253s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4284830c-0103-42dc-a096-5e29c9fae0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (187a545e-0686-43ec-bc76-2bd5482033c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:18 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] Volume volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4 (7d490a3d-b0f9-4671-bea7-d6526f998ab4): created successfully
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (187a545e-0686-43ec-bc76-2bd5482033c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] Flow 'volume_create_manager' (76f7f465-6f19-4d0e-b1ed-4a12e61ee065) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:18 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-919d44cd-dada-4efd-a1d7-eb31c79aabcd tempest-CinderUnicodeTest-1762020202 None] Created volume successfully.
Nov 05 10:02:18 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-986e8522-014f-413b-a35c-6774680b1675 tempest-ProjectReaderTests-262894575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.281s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-986e8522-014f-413b-a35c-6774680b1675 tempest-ProjectReaderTests-262894575 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:02:18 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-986e8522-014f-413b-a35c-6774680b1675 tempest-ProjectReaderTests-262894575 None] Deleted volume successfully.
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-986e8522-014f-413b-a35c-6774680b1675 tempest-ProjectReaderTests-262894575 None] Lock "cinder-dba0785b-2883-4666-bdd4-076b4e048da9-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] Flow 'volume_create_manager' (3dddbcfa-4035-4515-b5c8-22d09efdcfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df8e1c3d-45d9-49b8-9177-5e2aa68eae2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df8e1c3d-45d9-49b8-9177-5e2aa68eae2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-926611794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc0dda68-6fbf-4440-89f4-98600f8cb3e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cdf5343ab284123a6b4428c20259f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:19Z,use_quota=True,user_id='d7bbab2d671e4c3c9b059abc2e317fd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aea2f9d-6828-4a0c-b777-5dd9cbcdc97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aea2f9d-6828-4a0c-b777-5dd9cbcdc97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b95169eb-4528-4639-af58-a1ffc545d3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b95169eb-4528-4639-af58-a1ffc545d3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc0dda68-6fbf-4440-89f4-98600f8cb3e4', 'volume_name': 'volume-bc0dda68-6fbf-4440-89f4-98600f8cb3e4', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (866e1751-e026-40d3-b49d-4ce4606418a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (866e1751-e026-40d3-b49d-4ce4606418a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b55374ef-8393-44be-a557-3107500ae37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:18 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] Volume bc0dda68-6fbf-4440-89f4-98600f8cb3e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc0dda68-6fbf-4440-89f4-98600f8cb3e4', 'volume_size': 1}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-926611794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc0dda68-6fbf-4440-89f4-98600f8cb3e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cdf5343ab284123a6b4428c20259f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:19Z,use_quota=True,user_id='d7bbab2d671e4c3c9b059abc2e317fd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] Creating volume bc0dda68-6fbf-4440-89f4-98600f8cb3e4 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:02:18 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:02:18 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bc0dda68-6fbf-4440-89f4-98600f8cb3e4 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:19 devstack sudo[104403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bc0dda68-6fbf-4440-89f4-98600f8cb3e4 1073741824
Nov 05 10:02:19 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-56e9efde-4098-4d0a-b7d8-b4d9cf60590f tempest-ProjectReaderTests-1925760580 None] Acquiring lock "cinder-9bb40d08-9028-41bf-88c1-403c8ea919ad-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-56e9efde-4098-4d0a-b7d8-b4d9cf60590f tempest-ProjectReaderTests-1925760580 None] Lock "cinder-9bb40d08-9028-41bf-88c1-403c8ea919ad-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-56e9efde-4098-4d0a-b7d8-b4d9cf60590f tempest-ProjectReaderTests-1925760580 None] Acquiring lock "cinder-quobyte-9bb40d08-9028-41bf-88c1-403c8ea919ad" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:19 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-56e9efde-4098-4d0a-b7d8-b4d9cf60590f tempest-ProjectReaderTests-1925760580 None] Lock "cinder-quobyte-9bb40d08-9028-41bf-88c1-403c8ea919ad" acquired by "delete_volume" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:19 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9d8b7b-8c4a-44ee-875e-9d7f10b0d503]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-56e9efde-4098-4d0a-b7d8-b4d9cf60590f tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:19 devstack sudo[104408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad
Nov 05 10:02:19 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:19 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bc0dda68-6fbf-4440-89f4-98600f8cb3e4 1073741824" returned: 0 in 0.622s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bc0dda68-6fbf-4440-89f4-98600f8cb3e4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:19 devstack sudo[104412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bc0dda68-6fbf-4440-89f4-98600f8cb3e4
Nov 05 10:02:19 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:19 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-56e9efde-4098-4d0a-b7d8-b4d9cf60590f tempest-ProjectReaderTests-1925760580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad" returned: 0 in 0.501s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-56e9efde-4098-4d0a-b7d8-b4d9cf60590f tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:19 devstack sudo[104416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad
Nov 05 10:02:19 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:20 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bc0dda68-6fbf-4440-89f4-98600f8cb3e4" returned: 0 in 0.355s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:02:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b55374ef-8393-44be-a557-3107500ae37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc0dda68-6fbf-4440-89f4-98600f8cb3e4', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c637cc9-8cd8-4edb-bc5e-f8a7643a9592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dceabef1-6543-4014-8a1c-c6cfec4ca29b tempest-CinderUnicodeTest-1762020202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dceabef1-6543-4014-8a1c-c6cfec4ca29b tempest-CinderUnicodeTest-1762020202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-dceabef1-6543-4014-8a1c-c6cfec4ca29b tempest-CinderUnicodeTest-1762020202 None] Creating offline snapshot 0c0393ac-a8da-4ee8-aa0e-5ef1b67b0c1a of volume 7d490a3d-b0f9-4671-bea7-d6526f998ab4 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 10:02:20 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] Volume volume-bc0dda68-6fbf-4440-89f4-98600f8cb3e4 (bc0dda68-6fbf-4440-89f4-98600f8cb3e4): created successfully
Nov 05 10:02:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c637cc9-8cd8-4edb-bc5e-f8a7643a9592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:20 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] Flow 'volume_create_manager' (3dddbcfa-4035-4515-b5c8-22d09efdcfa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:20 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d507b047-f862-40b2-aba1-64aeab475400]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dceabef1-6543-4014-8a1c-c6cfec4ca29b tempest-CinderUnicodeTest-1762020202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:20 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-33aaff84-bee2-4929-9d90-5006c22c93a7 tempest-ProjectReaderTests-262894575 None] Created volume successfully.
Nov 05 10:02:20 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-56e9efde-4098-4d0a-b7d8-b4d9cf60590f tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-9bb40d08-9028-41bf-88c1-403c8ea919ad" returned: 0 in 0.330s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-56e9efde-4098-4d0a-b7d8-b4d9cf60590f tempest-ProjectReaderTests-1925760580 None] Lock "cinder-quobyte-9bb40d08-9028-41bf-88c1-403c8ea919ad" released by "delete_volume" :: held 0.918s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:20 devstack sudo[104420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4
Nov 05 10:02:20 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:20 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-56e9efde-4098-4d0a-b7d8-b4d9cf60590f tempest-ProjectReaderTests-1925760580 None] Created reservations ['a6d8e1b8-55f5-47ed-bc1d-d09ee622d91d', 'bce64c39-bb85-42c4-80ae-2575b0066202', '9d6181ec-7a5f-40bb-bb9e-162e9696b328', 'c4fb090f-9584-416b-85d3-6989a2cdbcad'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:02:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-56e9efde-4098-4d0a-b7d8-b4d9cf60590f tempest-ProjectReaderTests-1925760580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-56e9efde-4098-4d0a-b7d8-b4d9cf60590f tempest-ProjectReaderTests-1925760580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-56e9efde-4098-4d0a-b7d8-b4d9cf60590f tempest-ProjectReaderTests-1925760580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:20 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-56e9efde-4098-4d0a-b7d8-b4d9cf60590f tempest-ProjectReaderTests-1925760580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-56e9efde-4098-4d0a-b7d8-b4d9cf60590f tempest-ProjectReaderTests-1925760580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-56e9efde-4098-4d0a-b7d8-b4d9cf60590f tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:20 devstack sudo[104422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:02:20 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:20 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dceabef1-6543-4014-8a1c-c6cfec4ca29b tempest-CinderUnicodeTest-1762020202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4" returned: 0 in 0.419s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dceabef1-6543-4014-8a1c-c6cfec4ca29b tempest-CinderUnicodeTest-1762020202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4.0c0393ac-a8da-4ee8-aa0e-5ef1b67b0c1a 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:20 devstack sudo[104427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4.0c0393ac-a8da-4ee8-aa0e-5ef1b67b0c1a 1G
Nov 05 10:02:20 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:20 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-56e9efde-4098-4d0a-b7d8-b4d9cf60590f tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.312s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:20 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-56e9efde-4098-4d0a-b7d8-b4d9cf60590f tempest-ProjectReaderTests-1925760580 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:02:20 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-56e9efde-4098-4d0a-b7d8-b4d9cf60590f tempest-ProjectReaderTests-1925760580 None] Deleted volume successfully.
Nov 05 10:02:20 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-56e9efde-4098-4d0a-b7d8-b4d9cf60590f tempest-ProjectReaderTests-1925760580 None] Lock "cinder-9bb40d08-9028-41bf-88c1-403c8ea919ad-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:21 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dceabef1-6543-4014-8a1c-c6cfec4ca29b tempest-CinderUnicodeTest-1762020202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4.0c0393ac-a8da-4ee8-aa0e-5ef1b67b0c1a 1G" returned: 0 in 0.506s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dceabef1-6543-4014-8a1c-c6cfec4ca29b tempest-CinderUnicodeTest-1762020202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4.0c0393ac-a8da-4ee8-aa0e-5ef1b67b0c1a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3e222ea4-6ded-47ba-990e-2d453a085588 tempest-ProjectReaderTests-262894575 None] Acquiring lock "cinder-bc0dda68-6fbf-4440-89f4-98600f8cb3e4-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:21 devstack sudo[104434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4.0c0393ac-a8da-4ee8-aa0e-5ef1b67b0c1a
Nov 05 10:02:21 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3e222ea4-6ded-47ba-990e-2d453a085588 tempest-ProjectReaderTests-262894575 None] Lock "cinder-bc0dda68-6fbf-4440-89f4-98600f8cb3e4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3e222ea4-6ded-47ba-990e-2d453a085588 tempest-ProjectReaderTests-262894575 None] Acquiring lock "cinder-quobyte-bc0dda68-6fbf-4440-89f4-98600f8cb3e4" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:21 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3e222ea4-6ded-47ba-990e-2d453a085588 tempest-ProjectReaderTests-262894575 None] Lock "cinder-quobyte-bc0dda68-6fbf-4440-89f4-98600f8cb3e4" acquired by "delete_volume" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:21 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba002499-bd99-4e31-ad32-a01e28d294e5]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3e222ea4-6ded-47ba-990e-2d453a085588 tempest-ProjectReaderTests-262894575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bc0dda68-6fbf-4440-89f4-98600f8cb3e4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:21 devstack sudo[104436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bc0dda68-6fbf-4440-89f4-98600f8cb3e4
Nov 05 10:02:21 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:21 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dceabef1-6543-4014-8a1c-c6cfec4ca29b tempest-CinderUnicodeTest-1762020202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4.0c0393ac-a8da-4ee8-aa0e-5ef1b67b0c1a" returned: 0 in 0.387s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:21 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-dceabef1-6543-4014-8a1c-c6cfec4ca29b tempest-CinderUnicodeTest-1762020202 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4.0c0393ac-a8da-4ee8-aa0e-5ef1b67b0c1a is being set with open permissions: ugo+rw
Nov 05 10:02:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dceabef1-6543-4014-8a1c-c6cfec4ca29b tempest-CinderUnicodeTest-1762020202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4.0c0393ac-a8da-4ee8-aa0e-5ef1b67b0c1a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:21 devstack sudo[104442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4.0c0393ac-a8da-4ee8-aa0e-5ef1b67b0c1a
Nov 05 10:02:21 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:21 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3e222ea4-6ded-47ba-990e-2d453a085588 tempest-ProjectReaderTests-262894575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bc0dda68-6fbf-4440-89f4-98600f8cb3e4" returned: 0 in 0.521s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3e222ea4-6ded-47ba-990e-2d453a085588 tempest-ProjectReaderTests-262894575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bc0dda68-6fbf-4440-89f4-98600f8cb3e4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:21 devstack sudo[104449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bc0dda68-6fbf-4440-89f4-98600f8cb3e4
Nov 05 10:02:21 devstack sudo[104449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:21 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dceabef1-6543-4014-8a1c-c6cfec4ca29b tempest-CinderUnicodeTest-1762020202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4.0c0393ac-a8da-4ee8-aa0e-5ef1b67b0c1a" returned: 0 in 0.365s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dceabef1-6543-4014-8a1c-c6cfec4ca29b tempest-CinderUnicodeTest-1762020202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:21 devstack sudo[104451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4.info
Nov 05 10:02:21 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:02:22 devstack sudo[104449]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] Flow 'volume_create_manager' (a08606fd-6f14-4117-bc16-7c73527d9b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1a186d5-a3d9-4600-aae3-863269f7d836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3e222ea4-6ded-47ba-990e-2d453a085588 tempest-ProjectReaderTests-262894575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-bc0dda68-6fbf-4440-89f4-98600f8cb3e4" returned: 0 in 0.438s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1a186d5-a3d9-4600-aae3-863269f7d836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1773878442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f8c21e1-ff28-4b40-bdc3-3542468afb0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4c116ececd45e4b5529b715e3cb8f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:22Z,use_quota=True,user_id='0741a898ad034e74aef7144bf4cc9ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30d710a8-8536-4823-9057-c3cfb58d18e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30d710a8-8536-4823-9057-c3cfb58d18e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20098fc9-782f-4286-a2e7-5b7792f8524d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20098fc9-782f-4286-a2e7-5b7792f8524d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f8c21e1-ff28-4b40-bdc3-3542468afb0e', 'volume_name': 'volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bffbe4ee-bb44-471b-b609-6f50b8ee0e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bffbe4ee-bb44-471b-b609-6f50b8ee0e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:22 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39760744-d4a0-4221-9ded-0e93e3c90a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:22 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] Volume 0f8c21e1-ff28-4b40-bdc3-3542468afb0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e', 'volume_size': 1}
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3e222ea4-6ded-47ba-990e-2d453a085588 tempest-ProjectReaderTests-262894575 None] Lock "cinder-quobyte-bc0dda68-6fbf-4440-89f4-98600f8cb3e4" released by "delete_volume" :: held 1.072s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dceabef1-6543-4014-8a1c-c6cfec4ca29b tempest-CinderUnicodeTest-1762020202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4.info" returned: 0 in 0.410s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:22 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-dceabef1-6543-4014-8a1c-c6cfec4ca29b tempest-CinderUnicodeTest-1762020202 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4.info is being set with open permissions: ugo+rw
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dceabef1-6543-4014-8a1c-c6cfec4ca29b tempest-CinderUnicodeTest-1762020202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:22 devstack sudo[104455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4.info
Nov 05 10:02:22 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-3e222ea4-6ded-47ba-990e-2d453a085588 tempest-ProjectReaderTests-262894575 None] Created reservations ['7a96803b-8cd4-4247-9fc6-66fcbf7f2b84', '193e3483-4d71-4d50-a1ac-46198921a791', 'f6f692c6-e6d7-4caf-a40b-3cdc5df6c29d', '773b28be-2c18-42c3-8b15-ddcf02fe704a'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3e222ea4-6ded-47ba-990e-2d453a085588 tempest-ProjectReaderTests-262894575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3e222ea4-6ded-47ba-990e-2d453a085588 tempest-ProjectReaderTests-262894575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3e222ea4-6ded-47ba-990e-2d453a085588 tempest-ProjectReaderTests-262894575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-3e222ea4-6ded-47ba-990e-2d453a085588 tempest-ProjectReaderTests-262894575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3e222ea4-6ded-47ba-990e-2d453a085588 tempest-ProjectReaderTests-262894575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3e222ea4-6ded-47ba-990e-2d453a085588 tempest-ProjectReaderTests-262894575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:22 devstack sudo[104457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:02:22 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:22 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dceabef1-6543-4014-8a1c-c6cfec4ca29b tempest-CinderUnicodeTest-1762020202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4.info" returned: 0 in 0.296s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dceabef1-6543-4014-8a1c-c6cfec4ca29b tempest-CinderUnicodeTest-1762020202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.519s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.343s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1773878442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f8c21e1-ff28-4b40-bdc3-3542468afb0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4c116ececd45e4b5529b715e3cb8f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:22Z,use_quota=True,user_id='0741a898ad034e74aef7144bf4cc9ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] Creating volume 0f8c21e1-ff28-4b40-bdc3-3542468afb0e {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:02:22 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:22 devstack sudo[104460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e 1073741824
Nov 05 10:02:22 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:22 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-dceabef1-6543-4014-8a1c-c6cfec4ca29b tempest-CinderUnicodeTest-1762020202 None] Create snapshot completed successfully
Nov 05 10:02:22 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3e222ea4-6ded-47ba-990e-2d453a085588 tempest-ProjectReaderTests-262894575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.322s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-3e222ea4-6ded-47ba-990e-2d453a085588 tempest-ProjectReaderTests-262894575 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:02:22 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-3e222ea4-6ded-47ba-990e-2d453a085588 tempest-ProjectReaderTests-262894575 None] Deleted volume successfully.
Nov 05 10:02:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-3e222ea4-6ded-47ba-990e-2d453a085588 tempest-ProjectReaderTests-262894575 None] Lock "cinder-bc0dda68-6fbf-4440-89f4-98600f8cb3e4-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:23 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e 1073741824" returned: 0 in 0.543s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:23 devstack sudo[104467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e
Nov 05 10:02:23 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c9bb5991-4f8f-47ef-8a75-01f11ecf6e51 tempest-CinderUnicodeTest-1762020202 None] Acquiring lock "cinder-0c0393ac-a8da-4ee8-aa0e-5ef1b67b0c1a-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c9bb5991-4f8f-47ef-8a75-01f11ecf6e51 tempest-CinderUnicodeTest-1762020202 None] Lock "cinder-0c0393ac-a8da-4ee8-aa0e-5ef1b67b0c1a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c9bb5991-4f8f-47ef-8a75-01f11ecf6e51 tempest-CinderUnicodeTest-1762020202 None] Acquiring lock "cinder-quobyte-7d490a3d-b0f9-4671-bea7-d6526f998ab4" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c9bb5991-4f8f-47ef-8a75-01f11ecf6e51 tempest-CinderUnicodeTest-1762020202 None] Lock "cinder-quobyte-7d490a3d-b0f9-4671-bea7-d6526f998ab4" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c9bb5991-4f8f-47ef-8a75-01f11ecf6e51 tempest-CinderUnicodeTest-1762020202 None] Acquiring lock "cinder-quobyte-0c0393ac-a8da-4ee8-aa0e-5ef1b67b0c1a" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c9bb5991-4f8f-47ef-8a75-01f11ecf6e51 tempest-CinderUnicodeTest-1762020202 None] Lock "cinder-quobyte-0c0393ac-a8da-4ee8-aa0e-5ef1b67b0c1a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c9bb5991-4f8f-47ef-8a75-01f11ecf6e51 tempest-CinderUnicodeTest-1762020202 None] Deleting offline snapshot 0c0393ac-a8da-4ee8-aa0e-5ef1b67b0c1a of volume 7d490a3d-b0f9-4671-bea7-d6526f998ab4 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c9bb5991-4f8f-47ef-8a75-01f11ecf6e51 tempest-CinderUnicodeTest-1762020202 None] snapshot_file for this snap is: volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4.0c0393ac-a8da-4ee8-aa0e-5ef1b67b0c1a {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd33899-e326-4fee-800e-397fd35cb025]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c9bb5991-4f8f-47ef-8a75-01f11ecf6e51 tempest-CinderUnicodeTest-1762020202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4.0c0393ac-a8da-4ee8-aa0e-5ef1b67b0c1a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] Flow 'volume_create_manager' (70ba87be-aef7-4423-bb38-145779679125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a390df98-f220-402b-b944-76623823ef3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a390df98-f220-402b-b944-76623823ef3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1109133155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc17ae7b-b6d8-4023-add5-7f2964d6d2bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e528f8801a4697bc8112c19f08f0c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:23Z,use_quota=True,user_id='db806d37a63442189c00f5196322142a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eab0124-3e27-463c-a2b9-5dc6aa7e62c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eab0124-3e27-463c-a2b9-5dc6aa7e62c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d8be2c-f54a-4aec-90b4-f1d5c3fd9203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d8be2c-f54a-4aec-90b4-f1d5c3fd9203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc17ae7b-b6d8-4023-add5-7f2964d6d2bb', 'volume_name': 'volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e44eefb-8c22-46fa-a865-8347c0cd3b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e44eefb-8c22-46fa-a865-8347c0cd3b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3499e19-aef9-475f-8ac0-70b95d4c2a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:23 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] Volume fc17ae7b-b6d8-4023-add5-7f2964d6d2bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb', 'volume_size': 1}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:23 devstack sudo[104469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4.0c0393ac-a8da-4ee8-aa0e-5ef1b67b0c1a
Nov 05 10:02:23 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:23 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e" returned: 0 in 0.405s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.026s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1109133155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc17ae7b-b6d8-4023-add5-7f2964d6d2bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e528f8801a4697bc8112c19f08f0c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:23Z,use_quota=True,user_id='db806d37a63442189c00f5196322142a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] Creating volume fc17ae7b-b6d8-4023-add5-7f2964d6d2bb {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:02:23 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39760744-d4a0-4221-9ded-0e93e3c90a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:23 devstack sudo[104472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb 1073741824
Nov 05 10:02:23 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f91e3a87-24f6-4c37-9910-07f8f4f6af2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:23 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] Volume volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e (0f8c21e1-ff28-4b40-bdc3-3542468afb0e): created successfully
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f91e3a87-24f6-4c37-9910-07f8f4f6af2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] Flow 'volume_create_manager' (a08606fd-6f14-4117-bc16-7c73527d9b20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:23 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c88135e4-91f1-42ab-8aee-7a1ea1548d3e tempest-ProjectReaderTests-1925760580 None] Created volume successfully.
Nov 05 10:02:23 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c9bb5991-4f8f-47ef-8a75-01f11ecf6e51 tempest-CinderUnicodeTest-1762020202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4.0c0393ac-a8da-4ee8-aa0e-5ef1b67b0c1a" returned: 0 in 0.492s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c9bb5991-4f8f-47ef-8a75-01f11ecf6e51 tempest-CinderUnicodeTest-1762020202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[5022b811-a5c2-4482-abf9-0fb9d0c21675]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c9bb5991-4f8f-47ef-8a75-01f11ecf6e51 tempest-CinderUnicodeTest-1762020202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:24 devstack sudo[104480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4
Nov 05 10:02:24 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:24 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb 1073741824" returned: 0 in 0.607s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:24 devstack sudo[104482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb
Nov 05 10:02:24 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:24 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c9bb5991-4f8f-47ef-8a75-01f11ecf6e51 tempest-CinderUnicodeTest-1762020202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4" returned: 0 in 0.548s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c9bb5991-4f8f-47ef-8a75-01f11ecf6e51 tempest-CinderUnicodeTest-1762020202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4.0c0393ac-a8da-4ee8-aa0e-5ef1b67b0c1a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ca9a4eed-6f8c-4e71-8d28-b5f4f017959f tempest-ProjectReaderTests-1925760580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:24 devstack sudo[104487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4.0c0393ac-a8da-4ee8-aa0e-5ef1b67b0c1a
Nov 05 10:02:24 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:24 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb" returned: 0 in 0.310s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:02:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ca9a4eed-6f8c-4e71-8d28-b5f4f017959f tempest-ProjectReaderTests-1925760580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.045s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3499e19-aef9-475f-8ac0-70b95d4c2a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4737f233-a4cf-4b71-b27c-f382992187d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:24 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-ca9a4eed-6f8c-4e71-8d28-b5f4f017959f tempest-ProjectReaderTests-1925760580 None] Creating offline snapshot 3cf0ad34-d693-40c7-abc5-77df71d03f75 of volume 0f8c21e1-ff28-4b40-bdc3-3542468afb0e {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 10:02:24 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] Volume volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb (fc17ae7b-b6d8-4023-add5-7f2964d6d2bb): created successfully
Nov 05 10:02:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4737f233-a4cf-4b71-b27c-f382992187d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:24 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] Flow 'volume_create_manager' (70ba87be-aef7-4423-bb38-145779679125) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:24 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddad03b4-987d-411a-b33d-3d6fcf2f6c26]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca9a4eed-6f8c-4e71-8d28-b5f4f017959f tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:24 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-897b5b0c-0015-47f8-91c1-2e665a98036e tempest-ProjectMemberTests-1394267937 None] Created volume successfully.
Nov 05 10:02:24 devstack sudo[104490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e
Nov 05 10:02:24 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:24 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c9bb5991-4f8f-47ef-8a75-01f11ecf6e51 tempest-CinderUnicodeTest-1762020202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4.0c0393ac-a8da-4ee8-aa0e-5ef1b67b0c1a" returned: 0 in 0.474s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c9bb5991-4f8f-47ef-8a75-01f11ecf6e51 tempest-CinderUnicodeTest-1762020202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4.0c0393ac-a8da-4ee8-aa0e-5ef1b67b0c1a {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:25 devstack sudo[104496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4.0c0393ac-a8da-4ee8-aa0e-5ef1b67b0c1a
Nov 05 10:02:25 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:25 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca9a4eed-6f8c-4e71-8d28-b5f4f017959f tempest-ProjectReaderTests-1925760580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e" returned: 0 in 0.483s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca9a4eed-6f8c-4e71-8d28-b5f4f017959f tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e.3cf0ad34-d693-40c7-abc5-77df71d03f75 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:25 devstack sudo[104501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e.3cf0ad34-d693-40c7-abc5-77df71d03f75 1G
Nov 05 10:02:25 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:25 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c9bb5991-4f8f-47ef-8a75-01f11ecf6e51 tempest-CinderUnicodeTest-1762020202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4.0c0393ac-a8da-4ee8-aa0e-5ef1b67b0c1a" returned: 0 in 0.296s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:25 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c9bb5991-4f8f-47ef-8a75-01f11ecf6e51 tempest-CinderUnicodeTest-1762020202 None] Lock "cinder-quobyte-0c0393ac-a8da-4ee8-aa0e-5ef1b67b0c1a" released by "_delete_snapshot" :: held 1.973s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:25 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c9bb5991-4f8f-47ef-8a75-01f11ecf6e51 tempest-CinderUnicodeTest-1762020202 None] Lock "cinder-quobyte-7d490a3d-b0f9-4671-bea7-d6526f998ab4" released by "delete_snapshot" :: held 2.010s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:25 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-c9bb5991-4f8f-47ef-8a75-01f11ecf6e51 tempest-CinderUnicodeTest-1762020202 None] Created reservations ['02754791-4ca9-4f21-9724-f67082b241eb', '3e2752f1-38f9-4316-868b-0884648f4cb9', '72b9af17-5baa-4aef-aa32-cd91a2849a7e', 'e5aa090c-28bd-46ef-98b4-8fda9d6ba14b'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:02:25 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c9bb5991-4f8f-47ef-8a75-01f11ecf6e51 tempest-CinderUnicodeTest-1762020202 None] Delete snapshot completed successfully.
Nov 05 10:02:25 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c9bb5991-4f8f-47ef-8a75-01f11ecf6e51 tempest-CinderUnicodeTest-1762020202 None] Lock "cinder-0c0393ac-a8da-4ee8-aa0e-5ef1b67b0c1a-delete_snapshot" released by "delete_snapshot" :: held 2.221s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:25 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca9a4eed-6f8c-4e71-8d28-b5f4f017959f tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e.3cf0ad34-d693-40c7-abc5-77df71d03f75 1G" returned: 0 in 0.566s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca9a4eed-6f8c-4e71-8d28-b5f4f017959f tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e.3cf0ad34-d693-40c7-abc5-77df71d03f75 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:25 devstack sudo[104508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e.3cf0ad34-d693-40c7-abc5-77df71d03f75
Nov 05 10:02:25 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:26 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca9a4eed-6f8c-4e71-8d28-b5f4f017959f tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e.3cf0ad34-d693-40c7-abc5-77df71d03f75" returned: 0 in 0.324s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:26 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-ca9a4eed-6f8c-4e71-8d28-b5f4f017959f tempest-ProjectReaderTests-1925760580 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e.3cf0ad34-d693-40c7-abc5-77df71d03f75 is being set with open permissions: ugo+rw
Nov 05 10:02:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca9a4eed-6f8c-4e71-8d28-b5f4f017959f tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e.3cf0ad34-d693-40c7-abc5-77df71d03f75 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:26 devstack sudo[104513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e.3cf0ad34-d693-40c7-abc5-77df71d03f75
Nov 05 10:02:26 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-01a4b967-56d8-4626-904b-34387109e38d tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:26 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca9a4eed-6f8c-4e71-8d28-b5f4f017959f tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e.3cf0ad34-d693-40c7-abc5-77df71d03f75" returned: 0 in 0.318s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca9a4eed-6f8c-4e71-8d28-b5f4f017959f tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:26 devstack sudo[104516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e.info
Nov 05 10:02:26 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:26 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6c3641fd-8178-4820-9087-efd2fde5ed18 tempest-CinderUnicodeTest-1762020202 None] Acquiring lock "cinder-7d490a3d-b0f9-4671-bea7-d6526f998ab4-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:26 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6c3641fd-8178-4820-9087-efd2fde5ed18 tempest-CinderUnicodeTest-1762020202 None] Lock "cinder-7d490a3d-b0f9-4671-bea7-d6526f998ab4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:26 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6c3641fd-8178-4820-9087-efd2fde5ed18 tempest-CinderUnicodeTest-1762020202 None] Acquiring lock "cinder-quobyte-7d490a3d-b0f9-4671-bea7-d6526f998ab4" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:26 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca9a4eed-6f8c-4e71-8d28-b5f4f017959f tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e.info" returned: 0 in 0.311s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:26 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-ca9a4eed-6f8c-4e71-8d28-b5f4f017959f tempest-ProjectReaderTests-1925760580 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e.info is being set with open permissions: ugo+rw
Nov 05 10:02:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca9a4eed-6f8c-4e71-8d28-b5f4f017959f tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:26 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6c3641fd-8178-4820-9087-efd2fde5ed18 tempest-CinderUnicodeTest-1762020202 None] Lock "cinder-quobyte-7d490a3d-b0f9-4671-bea7-d6526f998ab4" acquired by "delete_volume" :: waited 0.041s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:26 devstack sudo[104519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e.info
Nov 05 10:02:26 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:26 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c8a3b1-e6d7-4a16-ad07-a311b70cdcae]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6c3641fd-8178-4820-9087-efd2fde5ed18 tempest-CinderUnicodeTest-1762020202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:26 devstack sudo[104521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4
Nov 05 10:02:26 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:26 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ca9a4eed-6f8c-4e71-8d28-b5f4f017959f tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e.info" returned: 0 in 0.285s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ca9a4eed-6f8c-4e71-8d28-b5f4f017959f tempest-ProjectReaderTests-1925760580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.441s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-01a4b967-56d8-4626-904b-34387109e38d tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.749s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-01a4b967-56d8-4626-904b-34387109e38d tempest-ProjectMemberTests-1394267937 None] Creating offline snapshot 4bcec2be-fdb9-46a7-abde-bf36153fa23e of volume fc17ae7b-b6d8-4023-add5-7f2964d6d2bb {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 10:02:27 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ca9a4eed-6f8c-4e71-8d28-b5f4f017959f tempest-ProjectReaderTests-1925760580 None] Create snapshot completed successfully
Nov 05 10:02:27 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c2cdce-c318-4a19-b3d8-5e0b9c8b8906]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-01a4b967-56d8-4626-904b-34387109e38d tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:27 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6c3641fd-8178-4820-9087-efd2fde5ed18 tempest-CinderUnicodeTest-1762020202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4" returned: 0 in 0.428s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6c3641fd-8178-4820-9087-efd2fde5ed18 tempest-CinderUnicodeTest-1762020202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:27 devstack sudo[104524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb
Nov 05 10:02:27 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:27 devstack sudo[104529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4
Nov 05 10:02:27 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:27 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6c3641fd-8178-4820-9087-efd2fde5ed18 tempest-CinderUnicodeTest-1762020202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-7d490a3d-b0f9-4671-bea7-d6526f998ab4" returned: 0 in 0.295s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6c3641fd-8178-4820-9087-efd2fde5ed18 tempest-CinderUnicodeTest-1762020202 None] Lock "cinder-quobyte-7d490a3d-b0f9-4671-bea7-d6526f998ab4" released by "delete_volume" :: held 0.814s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:27 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-01a4b967-56d8-4626-904b-34387109e38d tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb" returned: 0 in 0.451s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-01a4b967-56d8-4626-904b-34387109e38d tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb.4bcec2be-fdb9-46a7-abde-bf36153fa23e 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:27 devstack sudo[104535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb.4bcec2be-fdb9-46a7-abde-bf36153fa23e 1G
Nov 05 10:02:27 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:27 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-6c3641fd-8178-4820-9087-efd2fde5ed18 tempest-CinderUnicodeTest-1762020202 None] Created reservations ['bdd82ec6-1890-4c40-96fd-eec04ff4f151', 'b01e01ef-1eeb-4f9b-a4c7-bc344a9c0c8e', '5eece411-0df7-451f-85e3-ac91ce9052e2', 'd0c12495-8238-414e-8e2f-dcfde58691c1'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:02:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-479dacdb-c0f3-4c48-92be-88b4afabe102 tempest-ProjectReaderTests-1925760580 None] Acquiring lock "cinder-3cf0ad34-d693-40c7-abc5-77df71d03f75-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6c3641fd-8178-4820-9087-efd2fde5ed18 tempest-CinderUnicodeTest-1762020202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6c3641fd-8178-4820-9087-efd2fde5ed18 tempest-CinderUnicodeTest-1762020202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6c3641fd-8178-4820-9087-efd2fde5ed18 tempest-CinderUnicodeTest-1762020202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6c3641fd-8178-4820-9087-efd2fde5ed18 tempest-CinderUnicodeTest-1762020202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6c3641fd-8178-4820-9087-efd2fde5ed18 tempest-CinderUnicodeTest-1762020202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6c3641fd-8178-4820-9087-efd2fde5ed18 tempest-CinderUnicodeTest-1762020202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-479dacdb-c0f3-4c48-92be-88b4afabe102 tempest-ProjectReaderTests-1925760580 None] Lock "cinder-3cf0ad34-d693-40c7-abc5-77df71d03f75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.088s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-479dacdb-c0f3-4c48-92be-88b4afabe102 tempest-ProjectReaderTests-1925760580 None] Acquiring lock "cinder-quobyte-0f8c21e1-ff28-4b40-bdc3-3542468afb0e" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-479dacdb-c0f3-4c48-92be-88b4afabe102 tempest-ProjectReaderTests-1925760580 None] Lock "cinder-quobyte-0f8c21e1-ff28-4b40-bdc3-3542468afb0e" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:27 devstack sudo[104539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:02:27 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-479dacdb-c0f3-4c48-92be-88b4afabe102 tempest-ProjectReaderTests-1925760580 None] Acquiring lock "cinder-quobyte-3cf0ad34-d693-40c7-abc5-77df71d03f75" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ae4f6bae-d8ab-4da5-bc88-34a353464c84 tempest-CinderUnicodeTest-1762020202 None] Acquiring lock "cinder-eda45f24-920c-49ca-a46b-5da21cfa8eca-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-479dacdb-c0f3-4c48-92be-88b4afabe102 tempest-ProjectReaderTests-1925760580 None] Lock "cinder-quobyte-3cf0ad34-d693-40c7-abc5-77df71d03f75" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-479dacdb-c0f3-4c48-92be-88b4afabe102 tempest-ProjectReaderTests-1925760580 None] Deleting offline snapshot 3cf0ad34-d693-40c7-abc5-77df71d03f75 of volume 0f8c21e1-ff28-4b40-bdc3-3542468afb0e {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 10:02:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-479dacdb-c0f3-4c48-92be-88b4afabe102 tempest-ProjectReaderTests-1925760580 None] snapshot_file for this snap is: volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e.3cf0ad34-d693-40c7-abc5-77df71d03f75 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 10:02:27 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3cc7fa-af03-4629-b953-6764962de073]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:27 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ae4f6bae-d8ab-4da5-bc88-34a353464c84 tempest-CinderUnicodeTest-1762020202 None] Lock "cinder-eda45f24-920c-49ca-a46b-5da21cfa8eca-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-479dacdb-c0f3-4c48-92be-88b4afabe102 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e.3cf0ad34-d693-40c7-abc5-77df71d03f75 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:28 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ae4f6bae-d8ab-4da5-bc88-34a353464c84 tempest-CinderUnicodeTest-1762020202 None] Acquiring lock "cinder-quobyte-eda45f24-920c-49ca-a46b-5da21cfa8eca" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:28 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ae4f6bae-d8ab-4da5-bc88-34a353464c84 tempest-CinderUnicodeTest-1762020202 None] Lock "cinder-quobyte-eda45f24-920c-49ca-a46b-5da21cfa8eca" acquired by "delete_volume" :: waited 0.030s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:28 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[73854d52-b0d3-4765-8e2e-91e9800ef08f]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ae4f6bae-d8ab-4da5-bc88-34a353464c84 tempest-CinderUnicodeTest-1762020202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-eda45f24-920c-49ca-a46b-5da21cfa8eca {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:28 devstack sudo[104544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e.3cf0ad34-d693-40c7-abc5-77df71d03f75
Nov 05 10:02:28 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:28 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-01a4b967-56d8-4626-904b-34387109e38d tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb.4bcec2be-fdb9-46a7-abde-bf36153fa23e 1G" returned: 0 in 0.714s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-01a4b967-56d8-4626-904b-34387109e38d tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb.4bcec2be-fdb9-46a7-abde-bf36153fa23e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:28 devstack sudo[104549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb.4bcec2be-fdb9-46a7-abde-bf36153fa23e
Nov 05 10:02:28 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:28 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6c3641fd-8178-4820-9087-efd2fde5ed18 tempest-CinderUnicodeTest-1762020202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.552s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:28 devstack sudo[104546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-eda45f24-920c-49ca-a46b-5da21cfa8eca
Nov 05 10:02:28 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:28 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-6c3641fd-8178-4820-9087-efd2fde5ed18 tempest-CinderUnicodeTest-1762020202 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:02:28 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-6c3641fd-8178-4820-9087-efd2fde5ed18 tempest-CinderUnicodeTest-1762020202 None] Deleted volume successfully.
Nov 05 10:02:28 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6c3641fd-8178-4820-9087-efd2fde5ed18 tempest-CinderUnicodeTest-1762020202 None] Lock "cinder-7d490a3d-b0f9-4671-bea7-d6526f998ab4-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:28 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:02:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] Flow 'volume_create_manager' (5944a2f0-bc52-4421-8649-033051e9ed04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17f09cd4-3e3a-41f1-a121-35282c2ad260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17f09cd4-3e3a-41f1-a121-35282c2ad260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-182503793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=650d66a6-3bb8-4f91-82ad-1d61d8c98ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fba11f7ccf4457b8c37b2ad579705c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:28Z,use_quota=True,user_id='c4d78191c6594c2a85e280173d2113b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57515572-f5fc-400a-8137-9b49725dfe00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57515572-f5fc-400a-8137-9b49725dfe00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c9a3b6-7e71-4e67-bc86-c1bee38a0395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c9a3b6-7e71-4e67-bc86-c1bee38a0395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '650d66a6-3bb8-4f91-82ad-1d61d8c98ce1', 'volume_name': 'volume-650d66a6-3bb8-4f91-82ad-1d61d8c98ce1', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de033100-34d2-4838-a54d-ceba5c2c6606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de033100-34d2-4838-a54d-ceba5c2c6606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:28 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (210d6dd9-1650-466e-9602-f266c8657cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:28 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] Volume 650d66a6-3bb8-4f91-82ad-1d61d8c98ce1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-650d66a6-3bb8-4f91-82ad-1d61d8c98ce1', 'volume_size': 1}
Nov 05 10:02:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:28 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-479dacdb-c0f3-4c48-92be-88b4afabe102 tempest-ProjectReaderTests-1925760580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e.3cf0ad34-d693-40c7-abc5-77df71d03f75" returned: 0 in 0.613s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-479dacdb-c0f3-4c48-92be-88b4afabe102 tempest-ProjectReaderTests-1925760580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 10:02:28 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[b592fbb1-092f-4728-a862-7ba83d10c5b3]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-479dacdb-c0f3-4c48-92be-88b4afabe102 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:28 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-01a4b967-56d8-4626-904b-34387109e38d tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb.4bcec2be-fdb9-46a7-abde-bf36153fa23e" returned: 0 in 0.400s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:28 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-01a4b967-56d8-4626-904b-34387109e38d tempest-ProjectMemberTests-1394267937 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb.4bcec2be-fdb9-46a7-abde-bf36153fa23e is being set with open permissions: ugo+rw
Nov 05 10:02:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-01a4b967-56d8-4626-904b-34387109e38d tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb.4bcec2be-fdb9-46a7-abde-bf36153fa23e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:28 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ae4f6bae-d8ab-4da5-bc88-34a353464c84 tempest-CinderUnicodeTest-1762020202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-eda45f24-920c-49ca-a46b-5da21cfa8eca" returned: 0 in 0.546s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ae4f6bae-d8ab-4da5-bc88-34a353464c84 tempest-CinderUnicodeTest-1762020202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-eda45f24-920c-49ca-a46b-5da21cfa8eca {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:28 devstack sudo[104563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb.4bcec2be-fdb9-46a7-abde-bf36153fa23e
Nov 05 10:02:28 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:28 devstack sudo[104564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-eda45f24-920c-49ca-a46b-5da21cfa8eca
Nov 05 10:02:28 devstack sudo[104564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:28 devstack sudo[104562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e
Nov 05 10:02:28 devstack sudo[104562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:28 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-01a4b967-56d8-4626-904b-34387109e38d tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb.4bcec2be-fdb9-46a7-abde-bf36153fa23e" returned: 0 in 0.301s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:28 devstack sudo[104564]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ae4f6bae-d8ab-4da5-bc88-34a353464c84 tempest-CinderUnicodeTest-1762020202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-eda45f24-920c-49ca-a46b-5da21cfa8eca" returned: 0 in 0.301s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ae4f6bae-d8ab-4da5-bc88-34a353464c84 tempest-CinderUnicodeTest-1762020202 None] Lock "cinder-quobyte-eda45f24-920c-49ca-a46b-5da21cfa8eca" released by "delete_volume" :: held 0.921s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-01a4b967-56d8-4626-904b-34387109e38d tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:29 devstack sudo[104562]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-479dacdb-c0f3-4c48-92be-88b4afabe102 tempest-ProjectReaderTests-1925760580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e" returned: 0 in 0.428s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-479dacdb-c0f3-4c48-92be-88b4afabe102 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e.3cf0ad34-d693-40c7-abc5-77df71d03f75 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:29 devstack sudo[104573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb.info
Nov 05 10:02:29 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:29 devstack sudo[104575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e.3cf0ad34-d693-40c7-abc5-77df71d03f75
Nov 05 10:02:29 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-ae4f6bae-d8ab-4da5-bc88-34a353464c84 tempest-CinderUnicodeTest-1762020202 None] Created reservations ['859eda79-b159-4f5f-9a1f-bacafc2385aa', 'bd4369d5-1b18-4a67-aa55-3a70658283e3', 'b75a3b5b-f197-41c3-a5eb-c07f3fae9d2a', 'ae23ab77-07d7-42cd-97e4-7fc11f328502'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ae4f6bae-d8ab-4da5-bc88-34a353464c84 tempest-CinderUnicodeTest-1762020202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ae4f6bae-d8ab-4da5-bc88-34a353464c84 tempest-CinderUnicodeTest-1762020202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ae4f6bae-d8ab-4da5-bc88-34a353464c84 tempest-CinderUnicodeTest-1762020202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ae4f6bae-d8ab-4da5-bc88-34a353464c84 tempest-CinderUnicodeTest-1762020202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ae4f6bae-d8ab-4da5-bc88-34a353464c84 tempest-CinderUnicodeTest-1762020202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ae4f6bae-d8ab-4da5-bc88-34a353464c84 tempest-CinderUnicodeTest-1762020202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:29 devstack sudo[104577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:02:29 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:29 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-01a4b967-56d8-4626-904b-34387109e38d tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb.info" returned: 0 in 0.320s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:29 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-01a4b967-56d8-4626-904b-34387109e38d tempest-ProjectMemberTests-1394267937 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb.info is being set with open permissions: ugo+rw
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-01a4b967-56d8-4626-904b-34387109e38d tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:29 devstack sudo[104585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb.info
Nov 05 10:02:29 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:29 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-479dacdb-c0f3-4c48-92be-88b4afabe102 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e.3cf0ad34-d693-40c7-abc5-77df71d03f75" returned: 0 in 0.393s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-479dacdb-c0f3-4c48-92be-88b4afabe102 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e.3cf0ad34-d693-40c7-abc5-77df71d03f75 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:29 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ae4f6bae-d8ab-4da5-bc88-34a353464c84 tempest-CinderUnicodeTest-1762020202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.278s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-ae4f6bae-d8ab-4da5-bc88-34a353464c84 tempest-CinderUnicodeTest-1762020202 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:02:29 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ae4f6bae-d8ab-4da5-bc88-34a353464c84 tempest-CinderUnicodeTest-1762020202 None] Deleted volume successfully.
Nov 05 10:02:29 devstack sudo[104588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e.3cf0ad34-d693-40c7-abc5-77df71d03f75
Nov 05 10:02:29 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ae4f6bae-d8ab-4da5-bc88-34a353464c84 tempest-CinderUnicodeTest-1762020202 None] Lock "cinder-eda45f24-920c-49ca-a46b-5da21cfa8eca-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:29 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-01a4b967-56d8-4626-904b-34387109e38d tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb.info" returned: 0 in 0.297s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-01a4b967-56d8-4626-904b-34387109e38d tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.664s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.149s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-182503793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=650d66a6-3bb8-4f91-82ad-1d61d8c98ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fba11f7ccf4457b8c37b2ad579705c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:28Z,use_quota=True,user_id='c4d78191c6594c2a85e280173d2113b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] Creating volume 650d66a6-3bb8-4f91-82ad-1d61d8c98ce1 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:02:29 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-650d66a6-3bb8-4f91-82ad-1d61d8c98ce1 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:29 devstack sudo[104591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-650d66a6-3bb8-4f91-82ad-1d61d8c98ce1 1073741824
Nov 05 10:02:29 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:29 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-01a4b967-56d8-4626-904b-34387109e38d tempest-ProjectMemberTests-1394267937 None] Create snapshot completed successfully
Nov 05 10:02:29 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-479dacdb-c0f3-4c48-92be-88b4afabe102 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e.3cf0ad34-d693-40c7-abc5-77df71d03f75" returned: 0 in 0.309s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-479dacdb-c0f3-4c48-92be-88b4afabe102 tempest-ProjectReaderTests-1925760580 None] Lock "cinder-quobyte-3cf0ad34-d693-40c7-abc5-77df71d03f75" released by "_delete_snapshot" :: held 1.934s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-479dacdb-c0f3-4c48-92be-88b4afabe102 tempest-ProjectReaderTests-1925760580 None] Lock "cinder-quobyte-0f8c21e1-ff28-4b40-bdc3-3542468afb0e" released by "delete_snapshot" :: held 1.985s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-479dacdb-c0f3-4c48-92be-88b4afabe102 tempest-ProjectReaderTests-1925760580 None] Created reservations ['fdca5c68-9936-4965-9c37-61108149d79c', '0ffafacb-8ad4-4835-a96e-a70634dcb244', 'e56100e4-1934-4dc8-ad49-93a173b8c305', '92508120-a70c-42da-995b-62286e29fbdd'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:02:29 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-479dacdb-c0f3-4c48-92be-88b4afabe102 tempest-ProjectReaderTests-1925760580 None] Delete snapshot completed successfully.
Nov 05 10:02:29 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-479dacdb-c0f3-4c48-92be-88b4afabe102 tempest-ProjectReaderTests-1925760580 None] Lock "cinder-3cf0ad34-d693-40c7-abc5-77df71d03f75-delete_snapshot" released by "delete_snapshot" :: held 2.158s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:30 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-650d66a6-3bb8-4f91-82ad-1d61d8c98ce1 1073741824" returned: 0 in 0.498s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-650d66a6-3bb8-4f91-82ad-1d61d8c98ce1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:30 devstack sudo[104599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-650d66a6-3bb8-4f91-82ad-1d61d8c98ce1
Nov 05 10:02:30 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-db0a5116-a8ed-4f54-a210-8c05b4179e24 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-4bcec2be-fdb9-46a7-abde-bf36153fa23e-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:30 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-650d66a6-3bb8-4f91-82ad-1d61d8c98ce1" returned: 0 in 0.281s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:02:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-db0a5116-a8ed-4f54-a210-8c05b4179e24 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-4bcec2be-fdb9-46a7-abde-bf36153fa23e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-db0a5116-a8ed-4f54-a210-8c05b4179e24 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-quobyte-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (210d6dd9-1650-466e-9602-f266c8657cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-650d66a6-3bb8-4f91-82ad-1d61d8c98ce1', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3615fb00-dd20-4769-86bf-1754c72c3388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-db0a5116-a8ed-4f54-a210-8c05b4179e24 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-db0a5116-a8ed-4f54-a210-8c05b4179e24 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-quobyte-4bcec2be-fdb9-46a7-abde-bf36153fa23e" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:30 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] Volume volume-650d66a6-3bb8-4f91-82ad-1d61d8c98ce1 (650d66a6-3bb8-4f91-82ad-1d61d8c98ce1): created successfully
Nov 05 10:02:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3615fb00-dd20-4769-86bf-1754c72c3388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] Flow 'volume_create_manager' (5944a2f0-bc52-4421-8649-033051e9ed04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-db0a5116-a8ed-4f54-a210-8c05b4179e24 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-4bcec2be-fdb9-46a7-abde-bf36153fa23e" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-db0a5116-a8ed-4f54-a210-8c05b4179e24 tempest-ProjectMemberTests-1394267937 None] Deleting offline snapshot 4bcec2be-fdb9-46a7-abde-bf36153fa23e of volume fc17ae7b-b6d8-4023-add5-7f2964d6d2bb {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 10:02:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-db0a5116-a8ed-4f54-a210-8c05b4179e24 tempest-ProjectMemberTests-1394267937 None] snapshot_file for this snap is: volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb.4bcec2be-fdb9-46a7-abde-bf36153fa23e {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 10:02:30 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-904c60ee-da51-40c5-9ad4-a60cd1759b82 tempest-ProjectReaderTests-1618806998 None] Created volume successfully.
Nov 05 10:02:30 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8f0fba-cbc2-444e-9e0e-56d0ca4a88db]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-db0a5116-a8ed-4f54-a210-8c05b4179e24 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb.4bcec2be-fdb9-46a7-abde-bf36153fa23e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:30 devstack sudo[104602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb.4bcec2be-fdb9-46a7-abde-bf36153fa23e
Nov 05 10:02:30 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:30 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-290634a0-3852-4aaa-b819-45ddb0e84a7b tempest-ProjectReaderTests-1925760580 None] Acquiring lock "cinder-0f8c21e1-ff28-4b40-bdc3-3542468afb0e-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-290634a0-3852-4aaa-b819-45ddb0e84a7b tempest-ProjectReaderTests-1925760580 None] Lock "cinder-0f8c21e1-ff28-4b40-bdc3-3542468afb0e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-290634a0-3852-4aaa-b819-45ddb0e84a7b tempest-ProjectReaderTests-1925760580 None] Acquiring lock "cinder-quobyte-0f8c21e1-ff28-4b40-bdc3-3542468afb0e" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-290634a0-3852-4aaa-b819-45ddb0e84a7b tempest-ProjectReaderTests-1925760580 None] Lock "cinder-quobyte-0f8c21e1-ff28-4b40-bdc3-3542468afb0e" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:31 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-db0a5116-a8ed-4f54-a210-8c05b4179e24 tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb.4bcec2be-fdb9-46a7-abde-bf36153fa23e" returned: 0 in 0.477s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-db0a5116-a8ed-4f54-a210-8c05b4179e24 tempest-ProjectMemberTests-1394267937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 10:02:31 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d383c4a5-7b5a-4848-9001-fd7df30605a0]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-290634a0-3852-4aaa-b819-45ddb0e84a7b tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:31 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[748f2ed9-630d-4d34-9418-96fcd3982ac2]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-db0a5116-a8ed-4f54-a210-8c05b4179e24 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:31 devstack sudo[104607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e
Nov 05 10:02:31 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:31 devstack sudo[104608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb
Nov 05 10:02:31 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:31 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-290634a0-3852-4aaa-b819-45ddb0e84a7b tempest-ProjectReaderTests-1925760580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e" returned: 0 in 0.473s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-290634a0-3852-4aaa-b819-45ddb0e84a7b tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:31 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-db0a5116-a8ed-4f54-a210-8c05b4179e24 tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb" returned: 0 in 0.495s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-db0a5116-a8ed-4f54-a210-8c05b4179e24 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb.4bcec2be-fdb9-46a7-abde-bf36153fa23e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:31 devstack sudo[104617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e
Nov 05 10:02:31 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:31 devstack sudo[104618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb.4bcec2be-fdb9-46a7-abde-bf36153fa23e
Nov 05 10:02:31 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7c268740-db14-4d41-8753-d1359bfdbece tempest-ProjectReaderTests-1618806998 None] Acquiring lock "cinder-650d66a6-3bb8-4f91-82ad-1d61d8c98ce1-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:31 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-290634a0-3852-4aaa-b819-45ddb0e84a7b tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0f8c21e1-ff28-4b40-bdc3-3542468afb0e" returned: 0 in 0.348s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7c268740-db14-4d41-8753-d1359bfdbece tempest-ProjectReaderTests-1618806998 None] Lock "cinder-650d66a6-3bb8-4f91-82ad-1d61d8c98ce1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-290634a0-3852-4aaa-b819-45ddb0e84a7b tempest-ProjectReaderTests-1925760580 None] Lock "cinder-quobyte-0f8c21e1-ff28-4b40-bdc3-3542468afb0e" released by "delete_volume" :: held 0.927s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7c268740-db14-4d41-8753-d1359bfdbece tempest-ProjectReaderTests-1618806998 None] Acquiring lock "cinder-quobyte-650d66a6-3bb8-4f91-82ad-1d61d8c98ce1" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7c268740-db14-4d41-8753-d1359bfdbece tempest-ProjectReaderTests-1618806998 None] Lock "cinder-quobyte-650d66a6-3bb8-4f91-82ad-1d61d8c98ce1" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:32 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5418961-d840-419a-9c1e-6569764f71b1]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7c268740-db14-4d41-8753-d1359bfdbece tempest-ProjectReaderTests-1618806998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-650d66a6-3bb8-4f91-82ad-1d61d8c98ce1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:32 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-db0a5116-a8ed-4f54-a210-8c05b4179e24 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb.4bcec2be-fdb9-46a7-abde-bf36153fa23e" returned: 0 in 0.472s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-db0a5116-a8ed-4f54-a210-8c05b4179e24 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb.4bcec2be-fdb9-46a7-abde-bf36153fa23e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:32 devstack sudo[104627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb.4bcec2be-fdb9-46a7-abde-bf36153fa23e
Nov 05 10:02:32 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:32 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-290634a0-3852-4aaa-b819-45ddb0e84a7b tempest-ProjectReaderTests-1925760580 None] Created reservations ['c29ec71d-790e-4335-92bf-3d72d6261894', '36ca3538-ed5d-43c3-991c-439a48113b6e', '173a77af-f688-4903-95e0-fdb7a017de30', '9960fc7f-aedf-4bc8-8a0b-694636414927'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:02:32 devstack sudo[104626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-650d66a6-3bb8-4f91-82ad-1d61d8c98ce1
Nov 05 10:02:32 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-290634a0-3852-4aaa-b819-45ddb0e84a7b tempest-ProjectReaderTests-1925760580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-290634a0-3852-4aaa-b819-45ddb0e84a7b tempest-ProjectReaderTests-1925760580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:32 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-290634a0-3852-4aaa-b819-45ddb0e84a7b tempest-ProjectReaderTests-1925760580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:32 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-290634a0-3852-4aaa-b819-45ddb0e84a7b tempest-ProjectReaderTests-1925760580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-290634a0-3852-4aaa-b819-45ddb0e84a7b tempest-ProjectReaderTests-1925760580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-290634a0-3852-4aaa-b819-45ddb0e84a7b tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:32 devstack sudo[104630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:02:32 devstack sudo[104630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:32 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-db0a5116-a8ed-4f54-a210-8c05b4179e24 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb.4bcec2be-fdb9-46a7-abde-bf36153fa23e" returned: 0 in 0.353s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:32 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7c268740-db14-4d41-8753-d1359bfdbece tempest-ProjectReaderTests-1618806998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-650d66a6-3bb8-4f91-82ad-1d61d8c98ce1" returned: 0 in 0.435s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7c268740-db14-4d41-8753-d1359bfdbece tempest-ProjectReaderTests-1618806998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-650d66a6-3bb8-4f91-82ad-1d61d8c98ce1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-db0a5116-a8ed-4f54-a210-8c05b4179e24 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-4bcec2be-fdb9-46a7-abde-bf36153fa23e" released by "_delete_snapshot" :: held 1.966s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-db0a5116-a8ed-4f54-a210-8c05b4179e24 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb" released by "delete_snapshot" :: held 2.013s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:32 devstack sudo[104636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-650d66a6-3bb8-4f91-82ad-1d61d8c98ce1
Nov 05 10:02:32 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:32 devstack sudo[104630]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-290634a0-3852-4aaa-b819-45ddb0e84a7b tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.396s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:32 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-290634a0-3852-4aaa-b819-45ddb0e84a7b tempest-ProjectReaderTests-1925760580 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:02:32 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-290634a0-3852-4aaa-b819-45ddb0e84a7b tempest-ProjectReaderTests-1925760580 None] Deleted volume successfully.
Nov 05 10:02:32 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-db0a5116-a8ed-4f54-a210-8c05b4179e24 tempest-ProjectMemberTests-1394267937 None] Created reservations ['e1f8fc40-571c-4ddd-b57e-0ac691917680', '97788eff-d859-4aff-9188-c7c7c0a7542b', '216eb8f8-485c-4aff-8843-670a617a3401', '87ec0b12-b6aa-4911-9cab-86f6cd6d0423'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:02:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-290634a0-3852-4aaa-b819-45ddb0e84a7b tempest-ProjectReaderTests-1925760580 None] Lock "cinder-0f8c21e1-ff28-4b40-bdc3-3542468afb0e-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:32 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-db0a5116-a8ed-4f54-a210-8c05b4179e24 tempest-ProjectMemberTests-1394267937 None] Delete snapshot completed successfully.
Nov 05 10:02:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-db0a5116-a8ed-4f54-a210-8c05b4179e24 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-4bcec2be-fdb9-46a7-abde-bf36153fa23e-delete_snapshot" released by "delete_snapshot" :: held 2.296s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:32 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7c268740-db14-4d41-8753-d1359bfdbece tempest-ProjectReaderTests-1618806998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-650d66a6-3bb8-4f91-82ad-1d61d8c98ce1" returned: 0 in 0.345s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:32 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7c268740-db14-4d41-8753-d1359bfdbece tempest-ProjectReaderTests-1618806998 None] Lock "cinder-quobyte-650d66a6-3bb8-4f91-82ad-1d61d8c98ce1" released by "delete_volume" :: held 0.833s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:32 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-7c268740-db14-4d41-8753-d1359bfdbece tempest-ProjectReaderTests-1618806998 None] Created reservations ['848da3ea-9a21-4020-8b28-f84ecca38106', '74fc70af-f041-499b-a513-6cb00ba6edf2', '067523ae-850b-448d-a76d-585a2e60f7b3', 'af3d2488-11b7-4310-b7cd-9d4169180014'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:02:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7c268740-db14-4d41-8753-d1359bfdbece tempest-ProjectReaderTests-1618806998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7c268740-db14-4d41-8753-d1359bfdbece tempest-ProjectReaderTests-1618806998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:33 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7c268740-db14-4d41-8753-d1359bfdbece tempest-ProjectReaderTests-1618806998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:33 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7c268740-db14-4d41-8753-d1359bfdbece tempest-ProjectReaderTests-1618806998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7c268740-db14-4d41-8753-d1359bfdbece tempest-ProjectReaderTests-1618806998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7c268740-db14-4d41-8753-d1359bfdbece tempest-ProjectReaderTests-1618806998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:33 devstack sudo[104640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:02:33 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:33 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7c268740-db14-4d41-8753-d1359bfdbece tempest-ProjectReaderTests-1618806998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.385s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:33 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-7c268740-db14-4d41-8753-d1359bfdbece tempest-ProjectReaderTests-1618806998 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:02:33 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-7c268740-db14-4d41-8753-d1359bfdbece tempest-ProjectReaderTests-1618806998 None] Deleted volume successfully.
Nov 05 10:02:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7c268740-db14-4d41-8753-d1359bfdbece tempest-ProjectReaderTests-1618806998 None] Lock "cinder-650d66a6-3bb8-4f91-82ad-1d61d8c98ce1-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5b7da637-d0c1-47ce-8581-27c082f76d32 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5b7da637-d0c1-47ce-8581-27c082f76d32 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5b7da637-d0c1-47ce-8581-27c082f76d32 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-quobyte-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5b7da637-d0c1-47ce-8581-27c082f76d32 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb" acquired by "delete_volume" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:33 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[317d54b1-8bb4-4a29-8d23-0c9e98bc40d0]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5b7da637-d0c1-47ce-8581-27c082f76d32 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] Flow 'volume_create_manager' (596e3c97-6f65-4311-8123-e74f0bd6803d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dda42848-5f02-4e71-ba02-4a79cc236871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:34 devstack sudo[104644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb
Nov 05 10:02:34 devstack sudo[104644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dda42848-5f02-4e71-ba02-4a79cc236871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1133787709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0d56cc2-ac22-4940-beda-ed37fcfec6cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fba11f7ccf4457b8c37b2ad579705c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:34Z,use_quota=True,user_id='c4d78191c6594c2a85e280173d2113b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffbc6db5-64e9-4045-bd57-ac185327dc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffbc6db5-64e9-4045-bd57-ac185327dc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87d3f1b0-ef93-471c-b262-fa0a600bbb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87d3f1b0-ef93-471c-b262-fa0a600bbb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0d56cc2-ac22-4940-beda-ed37fcfec6cc', 'volume_name': 'volume-c0d56cc2-ac22-4940-beda-ed37fcfec6cc', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bdf6373-6d8e-4e9e-b697-59781a6cbf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bdf6373-6d8e-4e9e-b697-59781a6cbf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9e0e49-596e-4f50-8bce-97a302bb1de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:34 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] Volume c0d56cc2-ac22-4940-beda-ed37fcfec6cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0d56cc2-ac22-4940-beda-ed37fcfec6cc', 'volume_size': 1}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1133787709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0d56cc2-ac22-4940-beda-ed37fcfec6cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fba11f7ccf4457b8c37b2ad579705c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:34Z,use_quota=True,user_id='c4d78191c6594c2a85e280173d2113b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] Creating volume c0d56cc2-ac22-4940-beda-ed37fcfec6cc {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:02:34 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c0d56cc2-ac22-4940-beda-ed37fcfec6cc 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:02:34 devstack sudo[104646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c0d56cc2-ac22-4940-beda-ed37fcfec6cc 1073741824
Nov 05 10:02:34 devstack sudo[104646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] Flow 'volume_create_manager' (90f3125d-da5f-4051-86a2-a2f011014bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f68de90-db05-4ec7-9990-1b3ecec9e792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f68de90-db05-4ec7-9990-1b3ecec9e792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-694870787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fdffdb4-1a78-4664-861c-d2416100d1bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4c116ececd45e4b5529b715e3cb8f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:34Z,use_quota=True,user_id='0741a898ad034e74aef7144bf4cc9ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d958c1c7-c87e-475a-86c4-2d6833b1803b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d958c1c7-c87e-475a-86c4-2d6833b1803b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (965ba141-8744-4ba6-9438-ff315e8dc07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (965ba141-8744-4ba6-9438-ff315e8dc07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fdffdb4-1a78-4664-861c-d2416100d1bd', 'volume_name': 'volume-5fdffdb4-1a78-4664-861c-d2416100d1bd', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bcee95d-cf8c-475e-bf0f-748602eb313e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bcee95d-cf8c-475e-bf0f-748602eb313e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99e69635-0a52-468e-bc52-d69be20cf593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:34 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] Volume 5fdffdb4-1a78-4664-861c-d2416100d1bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fdffdb4-1a78-4664-861c-d2416100d1bd', 'volume_size': 1}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:34 devstack sudo[104644]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5b7da637-d0c1-47ce-8581-27c082f76d32 tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb" returned: 0 in 0.441s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5b7da637-d0c1-47ce-8581-27c082f76d32 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:34 devstack sudo[104651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb
Nov 05 10:02:34 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:34 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5b7da637-d0c1-47ce-8581-27c082f76d32 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb" returned: 0 in 0.333s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5b7da637-d0c1-47ce-8581-27c082f76d32 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb" released by "delete_volume" :: held 0.873s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:34 devstack sudo[104646]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c0d56cc2-ac22-4940-beda-ed37fcfec6cc 1073741824" returned: 0 in 0.583s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c0d56cc2-ac22-4940-beda-ed37fcfec6cc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-5b7da637-d0c1-47ce-8581-27c082f76d32 tempest-ProjectMemberTests-1394267937 None] Created reservations ['6f852f2e-5f4b-433f-9b79-222e6f8323bf', '92da870b-d35b-4af3-95d2-2579554611c7', '71a50e26-0088-4a7e-9c64-375d442fe4d5', '9d7da40d-b4a5-427d-85c1-422f43123af9'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:02:34 devstack sudo[104657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c0d56cc2-ac22-4940-beda-ed37fcfec6cc
Nov 05 10:02:34 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5b7da637-d0c1-47ce-8581-27c082f76d32 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5b7da637-d0c1-47ce-8581-27c082f76d32 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5b7da637-d0c1-47ce-8581-27c082f76d32 tempest-ProjectMemberTests-1394267937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5b7da637-d0c1-47ce-8581-27c082f76d32 tempest-ProjectMemberTests-1394267937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5b7da637-d0c1-47ce-8581-27c082f76d32 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5b7da637-d0c1-47ce-8581-27c082f76d32 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:35 devstack sudo[104659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:02:35 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:35 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c0d56cc2-ac22-4940-beda-ed37fcfec6cc" returned: 0 in 0.345s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.885s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-694870787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fdffdb4-1a78-4664-861c-d2416100d1bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4c116ececd45e4b5529b715e3cb8f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:34Z,use_quota=True,user_id='0741a898ad034e74aef7144bf4cc9ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] Creating volume 5fdffdb4-1a78-4664-861c-d2416100d1bd {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:02:35 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:35 devstack sudo[104662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd 1073741824
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9e0e49-596e-4f50-8bce-97a302bb1de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0d56cc2-ac22-4940-beda-ed37fcfec6cc', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:35 devstack sudo[104662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (685375a6-3470-4e83-a906-3ead439417d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:35 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] Volume volume-c0d56cc2-ac22-4940-beda-ed37fcfec6cc (c0d56cc2-ac22-4940-beda-ed37fcfec6cc): created successfully
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (685375a6-3470-4e83-a906-3ead439417d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] Flow 'volume_create_manager' (596e3c97-6f65-4311-8123-e74f0bd6803d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:35 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-dcd80a55-59f0-446e-be82-78748c879dab tempest-ProjectReaderTests-1618806998 None] Created volume successfully.
Nov 05 10:02:35 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5b7da637-d0c1-47ce-8581-27c082f76d32 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.386s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-5b7da637-d0c1-47ce-8581-27c082f76d32 tempest-ProjectMemberTests-1394267937 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:02:35 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-5b7da637-d0c1-47ce-8581-27c082f76d32 tempest-ProjectMemberTests-1394267937 None] Deleted volume successfully.
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5b7da637-d0c1-47ce-8581-27c082f76d32 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-fc17ae7b-b6d8-4023-add5-7f2964d6d2bb-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] Flow 'volume_create_manager' (1dd05e86-efc0-4347-9f1e-e3cb9e1b9f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41a0bf81-d33b-4aaa-90a7-b73995863463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41a0bf81-d33b-4aaa-90a7-b73995863463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-818151184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3537280c-cb56-4b62-84b1-a779bba4d49d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e528f8801a4697bc8112c19f08f0c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:36Z,use_quota=True,user_id='db806d37a63442189c00f5196322142a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ccf88d-04fc-4d92-8f1f-b04913b38f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ccf88d-04fc-4d92-8f1f-b04913b38f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecaf01bc-d813-4e0e-bda9-bc54345b5808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecaf01bc-d813-4e0e-bda9-bc54345b5808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3537280c-cb56-4b62-84b1-a779bba4d49d', 'volume_name': 'volume-3537280c-cb56-4b62-84b1-a779bba4d49d', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc35a29-fb72-4638-8d07-7aac4e750cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc35a29-fb72-4638-8d07-7aac4e750cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97550cd0-7b35-458f-ac61-5e1355bd7d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:35 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] Volume 3537280c-cb56-4b62-84b1-a779bba4d49d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3537280c-cb56-4b62-84b1-a779bba4d49d', 'volume_size': 1}
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:35 devstack sudo[104662]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd 1073741824" returned: 0 in 0.667s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:35 devstack sudo[104669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd
Nov 05 10:02:35 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ba8eed2a-8350-410b-b78f-04f2e9ce6067 tempest-ProjectReaderTests-1618806998 None] Acquiring lock "cinder-c0d56cc2-ac22-4940-beda-ed37fcfec6cc-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ba8eed2a-8350-410b-b78f-04f2e9ce6067 tempest-ProjectReaderTests-1618806998 None] Lock "cinder-c0d56cc2-ac22-4940-beda-ed37fcfec6cc-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ba8eed2a-8350-410b-b78f-04f2e9ce6067 tempest-ProjectReaderTests-1618806998 None] Acquiring lock "cinder-quobyte-c0d56cc2-ac22-4940-beda-ed37fcfec6cc" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ba8eed2a-8350-410b-b78f-04f2e9ce6067 tempest-ProjectReaderTests-1618806998 None] Lock "cinder-quobyte-c0d56cc2-ac22-4940-beda-ed37fcfec6cc" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:36 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea07eab7-d248-43c4-b68e-b295ba516a03]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ba8eed2a-8350-410b-b78f-04f2e9ce6067 tempest-ProjectReaderTests-1618806998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c0d56cc2-ac22-4940-beda-ed37fcfec6cc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:36 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd" returned: 0 in 0.290s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:02:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.407s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-818151184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3537280c-cb56-4b62-84b1-a779bba4d49d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e528f8801a4697bc8112c19f08f0c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:36Z,use_quota=True,user_id='db806d37a63442189c00f5196322142a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:02:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] Creating volume 3537280c-cb56-4b62-84b1-a779bba4d49d {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:02:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:02:36 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:02:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:36 devstack sudo[104671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c0d56cc2-ac22-4940-beda-ed37fcfec6cc
Nov 05 10:02:36 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99e69635-0a52-468e-bc52-d69be20cf593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fdffdb4-1a78-4664-861c-d2416100d1bd', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:36 devstack sudo[104673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d 1073741824
Nov 05 10:02:36 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b07d3a8-5790-490b-97da-3cd8f1f423b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:36 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] Volume volume-5fdffdb4-1a78-4664-861c-d2416100d1bd (5fdffdb4-1a78-4664-861c-d2416100d1bd): created successfully
Nov 05 10:02:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b07d3a8-5790-490b-97da-3cd8f1f423b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] Flow 'volume_create_manager' (90f3125d-da5f-4051-86a2-a2f011014bc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:36 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-5db08d1e-5ef2-4651-bfbd-dde8357e96f8 tempest-ProjectReaderTests-1925760580 None] Created volume successfully.
Nov 05 10:02:36 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ba8eed2a-8350-410b-b78f-04f2e9ce6067 tempest-ProjectReaderTests-1618806998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c0d56cc2-ac22-4940-beda-ed37fcfec6cc" returned: 0 in 0.430s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ba8eed2a-8350-410b-b78f-04f2e9ce6067 tempest-ProjectReaderTests-1618806998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c0d56cc2-ac22-4940-beda-ed37fcfec6cc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:36 devstack sudo[104683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c0d56cc2-ac22-4940-beda-ed37fcfec6cc
Nov 05 10:02:36 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:36 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d 1073741824" returned: 0 in 0.534s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:36 devstack sudo[104686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d
Nov 05 10:02:36 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:36 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ba8eed2a-8350-410b-b78f-04f2e9ce6067 tempest-ProjectReaderTests-1618806998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c0d56cc2-ac22-4940-beda-ed37fcfec6cc" returned: 0 in 0.317s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ba8eed2a-8350-410b-b78f-04f2e9ce6067 tempest-ProjectReaderTests-1618806998 None] Lock "cinder-quobyte-c0d56cc2-ac22-4940-beda-ed37fcfec6cc" released by "delete_volume" :: held 0.798s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:36 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-ba8eed2a-8350-410b-b78f-04f2e9ce6067 tempest-ProjectReaderTests-1618806998 None] Created reservations ['2f2d9c61-c993-4a95-9479-0256216dfa5b', '6b925c7e-2312-4d4d-8fd5-0643653a5d20', 'fb7a3c11-6354-4c7e-bc92-91581c30f547', 'ac17056f-5a9b-4ad2-83fe-80532f5c1820'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:02:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ba8eed2a-8350-410b-b78f-04f2e9ce6067 tempest-ProjectReaderTests-1618806998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ba8eed2a-8350-410b-b78f-04f2e9ce6067 tempest-ProjectReaderTests-1618806998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ba8eed2a-8350-410b-b78f-04f2e9ce6067 tempest-ProjectReaderTests-1618806998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ba8eed2a-8350-410b-b78f-04f2e9ce6067 tempest-ProjectReaderTests-1618806998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ba8eed2a-8350-410b-b78f-04f2e9ce6067 tempest-ProjectReaderTests-1618806998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ba8eed2a-8350-410b-b78f-04f2e9ce6067 tempest-ProjectReaderTests-1618806998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:37 devstack sudo[104690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:02:37 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:37 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d" returned: 0 in 0.359s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:02:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97550cd0-7b35-458f-ac61-5e1355bd7d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3537280c-cb56-4b62-84b1-a779bba4d49d', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267f14c0-6eb6-4b49-8292-3a7362c24dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:37 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] Volume volume-3537280c-cb56-4b62-84b1-a779bba4d49d (3537280c-cb56-4b62-84b1-a779bba4d49d): created successfully
Nov 05 10:02:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267f14c0-6eb6-4b49-8292-3a7362c24dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] Flow 'volume_create_manager' (1dd05e86-efc0-4347-9f1e-e3cb9e1b9f4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:37 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-5cd1c386-a17e-42fc-8c2b-509bc099e4d0 tempest-ProjectMemberTests-1394267937 None] Created volume successfully.
Nov 05 10:02:37 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ba8eed2a-8350-410b-b78f-04f2e9ce6067 tempest-ProjectReaderTests-1618806998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.331s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:37 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-ba8eed2a-8350-410b-b78f-04f2e9ce6067 tempest-ProjectReaderTests-1618806998 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:02:37 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ba8eed2a-8350-410b-b78f-04f2e9ce6067 tempest-ProjectReaderTests-1618806998 None] Deleted volume successfully.
Nov 05 10:02:37 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ba8eed2a-8350-410b-b78f-04f2e9ce6067 tempest-ProjectReaderTests-1618806998 None] Lock "cinder-c0d56cc2-ac22-4940-beda-ed37fcfec6cc-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-31a4534d-9534-4ce2-9b8d-67f61071ebc8 tempest-ProjectReaderTests-1925760580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-31a4534d-9534-4ce2-9b8d-67f61071ebc8 tempest-ProjectReaderTests-1925760580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-31a4534d-9534-4ce2-9b8d-67f61071ebc8 tempest-ProjectReaderTests-1925760580 None] Creating offline snapshot 88eebdba-0654-478a-9314-c7d4394f4191 of volume 5fdffdb4-1a78-4664-861c-d2416100d1bd {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 10:02:37 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4051a8-9171-4cdf-a492-39b7bdbf41ed]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-31a4534d-9534-4ce2-9b8d-67f61071ebc8 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:37 devstack sudo[104693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd
Nov 05 10:02:37 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:37 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:02:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] Flow 'volume_create_manager' (3a316b99-9a0f-4357-873f-1d86d9c5f2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aa17fdc-9d65-4d08-bbeb-38cbbb97b6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aa17fdc-9d65-4d08-bbeb-38cbbb97b6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-844628704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91c3ab2b-82c0-42b0-b4e9-db8297b414b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fba11f7ccf4457b8c37b2ad579705c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:38Z,use_quota=True,user_id='c4d78191c6594c2a85e280173d2113b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0268fa8d-1181-40b4-8ec9-4e38c22230cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0268fa8d-1181-40b4-8ec9-4e38c22230cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79304fa3-96dc-46a1-9eb8-e3d508006bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:37 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79304fa3-96dc-46a1-9eb8-e3d508006bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91c3ab2b-82c0-42b0-b4e9-db8297b414b7', 'volume_name': 'volume-91c3ab2b-82c0-42b0-b4e9-db8297b414b7', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40378c23-d2e8-43d1-be20-c18a8f3557d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40378c23-d2e8-43d1-be20-c18a8f3557d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:38 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e84c7c0-c653-4cb4-8899-15e51729c2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:38 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] Volume 91c3ab2b-82c0-42b0-b4e9-db8297b414b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91c3ab2b-82c0-42b0-b4e9-db8297b414b7', 'volume_size': 1}
Nov 05 10:02:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3c07ac46-3e41-499b-99ed-77713033db40 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:38 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-31a4534d-9534-4ce2-9b8d-67f61071ebc8 tempest-ProjectReaderTests-1925760580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd" returned: 0 in 0.609s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-31a4534d-9534-4ce2-9b8d-67f61071ebc8 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd.88eebdba-0654-478a-9314-c7d4394f4191 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:38 devstack sudo[104698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd.88eebdba-0654-478a-9314-c7d4394f4191 1G
Nov 05 10:02:38 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:38 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-31a4534d-9534-4ce2-9b8d-67f61071ebc8 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd.88eebdba-0654-478a-9314-c7d4394f4191 1G" returned: 0 in 0.418s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-31a4534d-9534-4ce2-9b8d-67f61071ebc8 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fdffdb4-1a78-4664-861c-d2416100d1bd -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd.88eebdba-0654-478a-9314-c7d4394f4191 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:38 devstack sudo[104703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fdffdb4-1a78-4664-861c-d2416100d1bd -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd.88eebdba-0654-478a-9314-c7d4394f4191
Nov 05 10:02:38 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:38 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-31a4534d-9534-4ce2-9b8d-67f61071ebc8 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fdffdb4-1a78-4664-861c-d2416100d1bd -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd.88eebdba-0654-478a-9314-c7d4394f4191" returned: 0 in 0.300s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:38 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-31a4534d-9534-4ce2-9b8d-67f61071ebc8 tempest-ProjectReaderTests-1925760580 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd.88eebdba-0654-478a-9314-c7d4394f4191 is being set with open permissions: ugo+rw
Nov 05 10:02:38 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-31a4534d-9534-4ce2-9b8d-67f61071ebc8 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd.88eebdba-0654-478a-9314-c7d4394f4191 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:38 devstack sudo[104708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd.88eebdba-0654-478a-9314-c7d4394f4191
Nov 05 10:02:38 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:39 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-31a4534d-9534-4ce2-9b8d-67f61071ebc8 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd.88eebdba-0654-478a-9314-c7d4394f4191" returned: 0 in 0.257s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-31a4534d-9534-4ce2-9b8d-67f61071ebc8 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:39 devstack sudo[104711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd.info
Nov 05 10:02:39 devstack sudo[104711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:39 devstack sudo[104711]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-31a4534d-9534-4ce2-9b8d-67f61071ebc8 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd.info" returned: 0 in 0.283s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:39 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-31a4534d-9534-4ce2-9b8d-67f61071ebc8 tempest-ProjectReaderTests-1925760580 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd.info is being set with open permissions: ugo+rw
Nov 05 10:02:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-31a4534d-9534-4ce2-9b8d-67f61071ebc8 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:39 devstack sudo[104716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd.info
Nov 05 10:02:39 devstack sudo[104716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:39 devstack sudo[104716]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-31a4534d-9534-4ce2-9b8d-67f61071ebc8 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd.info" returned: 0 in 0.260s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-31a4534d-9534-4ce2-9b8d-67f61071ebc8 tempest-ProjectReaderTests-1925760580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.224s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.729s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-844628704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91c3ab2b-82c0-42b0-b4e9-db8297b414b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fba11f7ccf4457b8c37b2ad579705c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:38Z,use_quota=True,user_id='c4d78191c6594c2a85e280173d2113b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:02:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] Creating volume 91c3ab2b-82c0-42b0-b4e9-db8297b414b7 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:02:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:39 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:02:39 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:02:39 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-91c3ab2b-82c0-42b0-b4e9-db8297b414b7 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:39 devstack sudo[104719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-91c3ab2b-82c0-42b0-b4e9-db8297b414b7 1073741824
Nov 05 10:02:39 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:39 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-31a4534d-9534-4ce2-9b8d-67f61071ebc8 tempest-ProjectReaderTests-1925760580 None] Create snapshot completed successfully
Nov 05 10:02:40 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-91c3ab2b-82c0-42b0-b4e9-db8297b414b7 1073741824" returned: 0 in 0.439s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-91c3ab2b-82c0-42b0-b4e9-db8297b414b7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:40 devstack sudo[104725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-91c3ab2b-82c0-42b0-b4e9-db8297b414b7
Nov 05 10:02:40 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:40 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-91c3ab2b-82c0-42b0-b4e9-db8297b414b7" returned: 0 in 0.247s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:02:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3c07ac46-3e41-499b-99ed-77713033db40 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.367s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e84c7c0-c653-4cb4-8899-15e51729c2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91c3ab2b-82c0-42b0-b4e9-db8297b414b7', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56884a75-de08-4a99-910c-88237f0781b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-3c07ac46-3e41-499b-99ed-77713033db40 tempest-ProjectMemberTests-1394267937 None] Creating offline snapshot 2ec85757-b876-47c8-8e90-62fcf5e31618 of volume 3537280c-cb56-4b62-84b1-a779bba4d49d {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 10:02:40 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] Volume volume-91c3ab2b-82c0-42b0-b4e9-db8297b414b7 (91c3ab2b-82c0-42b0-b4e9-db8297b414b7): created successfully
Nov 05 10:02:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56884a75-de08-4a99-910c-88237f0781b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:40 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] Flow 'volume_create_manager' (3a316b99-9a0f-4357-873f-1d86d9c5f2fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:40 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce88781-52de-4b30-a89b-20a641d691a5]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3c07ac46-3e41-499b-99ed-77713033db40 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:40 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-389ae666-64e9-4d53-a3a7-a5edff6957a9 tempest-ProjectReaderTests-1618806998 None] Created volume successfully.
Nov 05 10:02:40 devstack sudo[104728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d
Nov 05 10:02:40 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c7f6aba9-4112-458e-9e9b-d7a3a16c55dd tempest-ProjectReaderTests-1925760580 None] Acquiring lock "cinder-88eebdba-0654-478a-9314-c7d4394f4191-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c7f6aba9-4112-458e-9e9b-d7a3a16c55dd tempest-ProjectReaderTests-1925760580 None] Lock "cinder-88eebdba-0654-478a-9314-c7d4394f4191-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c7f6aba9-4112-458e-9e9b-d7a3a16c55dd tempest-ProjectReaderTests-1925760580 None] Acquiring lock "cinder-quobyte-5fdffdb4-1a78-4664-861c-d2416100d1bd" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c7f6aba9-4112-458e-9e9b-d7a3a16c55dd tempest-ProjectReaderTests-1925760580 None] Lock "cinder-quobyte-5fdffdb4-1a78-4664-861c-d2416100d1bd" acquired by "delete_snapshot" :: waited 0.066s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c7f6aba9-4112-458e-9e9b-d7a3a16c55dd tempest-ProjectReaderTests-1925760580 None] Acquiring lock "cinder-quobyte-88eebdba-0654-478a-9314-c7d4394f4191" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:40 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c7f6aba9-4112-458e-9e9b-d7a3a16c55dd tempest-ProjectReaderTests-1925760580 None] Lock "cinder-quobyte-88eebdba-0654-478a-9314-c7d4394f4191" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c7f6aba9-4112-458e-9e9b-d7a3a16c55dd tempest-ProjectReaderTests-1925760580 None] Deleting offline snapshot 88eebdba-0654-478a-9314-c7d4394f4191 of volume 5fdffdb4-1a78-4664-861c-d2416100d1bd {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 10:02:40 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c7f6aba9-4112-458e-9e9b-d7a3a16c55dd tempest-ProjectReaderTests-1925760580 None] snapshot_file for this snap is: volume-5fdffdb4-1a78-4664-861c-d2416100d1bd.88eebdba-0654-478a-9314-c7d4394f4191 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 10:02:40 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[3430a416-1064-4f3b-8543-864d948993ff]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c7f6aba9-4112-458e-9e9b-d7a3a16c55dd tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd.88eebdba-0654-478a-9314-c7d4394f4191 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:40 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3c07ac46-3e41-499b-99ed-77713033db40 tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d" returned: 0 in 0.388s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:40 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3c07ac46-3e41-499b-99ed-77713033db40 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d.2ec85757-b876-47c8-8e90-62fcf5e31618 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:40 devstack sudo[104730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd.88eebdba-0654-478a-9314-c7d4394f4191
Nov 05 10:02:40 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:40 devstack sudo[104734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d.2ec85757-b876-47c8-8e90-62fcf5e31618 1G
Nov 05 10:02:40 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:41 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c7f6aba9-4112-458e-9e9b-d7a3a16c55dd tempest-ProjectReaderTests-1925760580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd.88eebdba-0654-478a-9314-c7d4394f4191" returned: 0 in 0.410s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:41 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c7f6aba9-4112-458e-9e9b-d7a3a16c55dd tempest-ProjectReaderTests-1925760580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fdffdb4-1a78-4664-861c-d2416100d1bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 10:02:41 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4da7313-1a0b-4b23-b62d-f5ee7eb9d0da]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c7f6aba9-4112-458e-9e9b-d7a3a16c55dd tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f21b9d98-5599-4116-93cc-966bdb4bfe46 tempest-ProjectReaderTests-1618806998 None] Acquiring lock "cinder-91c3ab2b-82c0-42b0-b4e9-db8297b414b7-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f21b9d98-5599-4116-93cc-966bdb4bfe46 tempest-ProjectReaderTests-1618806998 None] Lock "cinder-91c3ab2b-82c0-42b0-b4e9-db8297b414b7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:41 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:41 devstack sudo[104743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd
Nov 05 10:02:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3c07ac46-3e41-499b-99ed-77713033db40 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d.2ec85757-b876-47c8-8e90-62fcf5e31618 1G" returned: 0 in 0.470s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3c07ac46-3e41-499b-99ed-77713033db40 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3537280c-cb56-4b62-84b1-a779bba4d49d -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d.2ec85757-b876-47c8-8e90-62fcf5e31618 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:41 devstack sudo[104743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:41 devstack sudo[104746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3537280c-cb56-4b62-84b1-a779bba4d49d -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d.2ec85757-b876-47c8-8e90-62fcf5e31618
Nov 05 10:02:41 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f21b9d98-5599-4116-93cc-966bdb4bfe46 tempest-ProjectReaderTests-1618806998 None] Acquiring lock "cinder-quobyte-91c3ab2b-82c0-42b0-b4e9-db8297b414b7" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:41 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f21b9d98-5599-4116-93cc-966bdb4bfe46 tempest-ProjectReaderTests-1618806998 None] Lock "cinder-quobyte-91c3ab2b-82c0-42b0-b4e9-db8297b414b7" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:41 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[8759bcbb-4118-4c6b-be22-4eebed639a4a]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f21b9d98-5599-4116-93cc-966bdb4bfe46 tempest-ProjectReaderTests-1618806998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-91c3ab2b-82c0-42b0-b4e9-db8297b414b7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:41 devstack sudo[104748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-91c3ab2b-82c0-42b0-b4e9-db8297b414b7
Nov 05 10:02:41 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:41 devstack sudo[104743]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c7f6aba9-4112-458e-9e9b-d7a3a16c55dd tempest-ProjectReaderTests-1925760580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd" returned: 0 in 0.448s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c7f6aba9-4112-458e-9e9b-d7a3a16c55dd tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd.88eebdba-0654-478a-9314-c7d4394f4191 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:41 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3c07ac46-3e41-499b-99ed-77713033db40 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3537280c-cb56-4b62-84b1-a779bba4d49d -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d.2ec85757-b876-47c8-8e90-62fcf5e31618" returned: 0 in 0.339s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:41 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-3c07ac46-3e41-499b-99ed-77713033db40 tempest-ProjectMemberTests-1394267937 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d.2ec85757-b876-47c8-8e90-62fcf5e31618 is being set with open permissions: ugo+rw
Nov 05 10:02:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3c07ac46-3e41-499b-99ed-77713033db40 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d.2ec85757-b876-47c8-8e90-62fcf5e31618 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:41 devstack sudo[104756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd.88eebdba-0654-478a-9314-c7d4394f4191
Nov 05 10:02:41 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:41 devstack sudo[104757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d.2ec85757-b876-47c8-8e90-62fcf5e31618
Nov 05 10:02:41 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:41 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f21b9d98-5599-4116-93cc-966bdb4bfe46 tempest-ProjectReaderTests-1618806998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-91c3ab2b-82c0-42b0-b4e9-db8297b414b7" returned: 0 in 0.394s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:41 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f21b9d98-5599-4116-93cc-966bdb4bfe46 tempest-ProjectReaderTests-1618806998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-91c3ab2b-82c0-42b0-b4e9-db8297b414b7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:41 devstack sudo[104763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-91c3ab2b-82c0-42b0-b4e9-db8297b414b7
Nov 05 10:02:41 devstack sudo[104763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:42 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3c07ac46-3e41-499b-99ed-77713033db40 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d.2ec85757-b876-47c8-8e90-62fcf5e31618" returned: 0 in 0.275s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3c07ac46-3e41-499b-99ed-77713033db40 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:42 devstack sudo[104769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d.info
Nov 05 10:02:42 devstack sudo[104769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:42 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c7f6aba9-4112-458e-9e9b-d7a3a16c55dd tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd.88eebdba-0654-478a-9314-c7d4394f4191" returned: 0 in 0.388s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c7f6aba9-4112-458e-9e9b-d7a3a16c55dd tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd.88eebdba-0654-478a-9314-c7d4394f4191 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:42 devstack sudo[104774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd.88eebdba-0654-478a-9314-c7d4394f4191
Nov 05 10:02:42 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:42 devstack sudo[104763]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f21b9d98-5599-4116-93cc-966bdb4bfe46 tempest-ProjectReaderTests-1618806998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-91c3ab2b-82c0-42b0-b4e9-db8297b414b7" returned: 0 in 0.287s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f21b9d98-5599-4116-93cc-966bdb4bfe46 tempest-ProjectReaderTests-1618806998 None] Lock "cinder-quobyte-91c3ab2b-82c0-42b0-b4e9-db8297b414b7" released by "delete_volume" :: held 0.736s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:42 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-f21b9d98-5599-4116-93cc-966bdb4bfe46 tempest-ProjectReaderTests-1618806998 None] Created reservations ['4d62afa5-3152-4e54-8202-810607449285', '28726053-6584-403e-a2d1-ffd47f301b50', '22ef6e9f-266e-4061-82ef-15d07e6a1eee', '91aa019c-e5e2-456d-9bfb-13b7893192af'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:02:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f21b9d98-5599-4116-93cc-966bdb4bfe46 tempest-ProjectReaderTests-1618806998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f21b9d98-5599-4116-93cc-966bdb4bfe46 tempest-ProjectReaderTests-1618806998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f21b9d98-5599-4116-93cc-966bdb4bfe46 tempest-ProjectReaderTests-1618806998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:42 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-f21b9d98-5599-4116-93cc-966bdb4bfe46 tempest-ProjectReaderTests-1618806998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f21b9d98-5599-4116-93cc-966bdb4bfe46 tempest-ProjectReaderTests-1618806998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f21b9d98-5599-4116-93cc-966bdb4bfe46 tempest-ProjectReaderTests-1618806998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:42 devstack sudo[104769]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3c07ac46-3e41-499b-99ed-77713033db40 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d.info" returned: 0 in 0.326s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:42 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-3c07ac46-3e41-499b-99ed-77713033db40 tempest-ProjectMemberTests-1394267937 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d.info is being set with open permissions: ugo+rw
Nov 05 10:02:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3c07ac46-3e41-499b-99ed-77713033db40 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:42 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c7f6aba9-4112-458e-9e9b-d7a3a16c55dd tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd.88eebdba-0654-478a-9314-c7d4394f4191" returned: 0 in 0.276s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:42 devstack sudo[104782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:02:42 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:42 devstack sudo[104783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d.info
Nov 05 10:02:42 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c7f6aba9-4112-458e-9e9b-d7a3a16c55dd tempest-ProjectReaderTests-1925760580 None] Lock "cinder-quobyte-88eebdba-0654-478a-9314-c7d4394f4191" released by "_delete_snapshot" :: held 1.659s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c7f6aba9-4112-458e-9e9b-d7a3a16c55dd tempest-ProjectReaderTests-1925760580 None] Lock "cinder-quobyte-5fdffdb4-1a78-4664-861c-d2416100d1bd" released by "delete_snapshot" :: held 1.684s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:42 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-c7f6aba9-4112-458e-9e9b-d7a3a16c55dd tempest-ProjectReaderTests-1925760580 None] Created reservations ['346c55b1-619d-4ef9-a8c9-bd0cf69db8ec', '326fe151-13b2-451d-8aea-ee4db32bfa39', '8ed863a5-e509-4b59-9611-6a6d71971079', '2d5100b8-8ea6-4ae4-8c70-2b44884e4f39'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:02:42 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c7f6aba9-4112-458e-9e9b-d7a3a16c55dd tempest-ProjectReaderTests-1925760580 None] Delete snapshot completed successfully.
Nov 05 10:02:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c7f6aba9-4112-458e-9e9b-d7a3a16c55dd tempest-ProjectReaderTests-1925760580 None] Lock "cinder-88eebdba-0654-478a-9314-c7d4394f4191-delete_snapshot" released by "delete_snapshot" :: held 1.916s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:42 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-3c07ac46-3e41-499b-99ed-77713033db40 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d.info" returned: 0 in 0.298s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:42 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3c07ac46-3e41-499b-99ed-77713033db40 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.215s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f21b9d98-5599-4116-93cc-966bdb4bfe46 tempest-ProjectReaderTests-1618806998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.342s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:42 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-f21b9d98-5599-4116-93cc-966bdb4bfe46 tempest-ProjectReaderTests-1618806998 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:02:42 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f21b9d98-5599-4116-93cc-966bdb4bfe46 tempest-ProjectReaderTests-1618806998 None] Deleted volume successfully.
Nov 05 10:02:42 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-3c07ac46-3e41-499b-99ed-77713033db40 tempest-ProjectMemberTests-1394267937 None] Create snapshot completed successfully
Nov 05 10:02:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-f21b9d98-5599-4116-93cc-966bdb4bfe46 tempest-ProjectReaderTests-1618806998 None] Lock "cinder-91c3ab2b-82c0-42b0-b4e9-db8297b414b7-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9ea9bdfd-bc9a-49ab-af89-38ed76dee231 tempest-ProjectReaderTests-1925760580 None] Acquiring lock "cinder-5fdffdb4-1a78-4664-861c-d2416100d1bd-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9ea9bdfd-bc9a-49ab-af89-38ed76dee231 tempest-ProjectReaderTests-1925760580 None] Lock "cinder-5fdffdb4-1a78-4664-861c-d2416100d1bd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9ea9bdfd-bc9a-49ab-af89-38ed76dee231 tempest-ProjectReaderTests-1925760580 None] Acquiring lock "cinder-quobyte-5fdffdb4-1a78-4664-861c-d2416100d1bd" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:42 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9ea9bdfd-bc9a-49ab-af89-38ed76dee231 tempest-ProjectReaderTests-1925760580 None] Lock "cinder-quobyte-5fdffdb4-1a78-4664-861c-d2416100d1bd" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:42 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d8011f-16c0-446e-a443-bdd215bc6711]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:42 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9ea9bdfd-bc9a-49ab-af89-38ed76dee231 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:02:43 devstack sudo[104788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] Flow 'volume_create_manager' (34f9c11f-dcb7-46e8-b00c-a6a895a9677b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:43 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e094ac8-a927-47f8-8ae8-5ff35963d19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e094ac8-a927-47f8-8ae8-5ff35963d19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-732147170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9a2f5a1-51f7-4308-a1e0-cdabf737d581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fba11f7ccf4457b8c37b2ad579705c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:43Z,use_quota=True,user_id='c4d78191c6594c2a85e280173d2113b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c93eb537-dafc-4ff2-b956-cce14e6a3e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c93eb537-dafc-4ff2-b956-cce14e6a3e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (123effce-b706-41e9-8c65-c1bea4adc415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (123effce-b706-41e9-8c65-c1bea4adc415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9a2f5a1-51f7-4308-a1e0-cdabf737d581', 'volume_name': 'volume-e9a2f5a1-51f7-4308-a1e0-cdabf737d581', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378516cf-e53a-4d8d-a784-95eb1ff6cd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378516cf-e53a-4d8d-a784-95eb1ff6cd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0538fff-0d37-48a8-882a-75c76404e246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:43 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] Volume e9a2f5a1-51f7-4308-a1e0-cdabf737d581: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9a2f5a1-51f7-4308-a1e0-cdabf737d581', 'volume_size': 1}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-732147170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9a2f5a1-51f7-4308-a1e0-cdabf737d581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fba11f7ccf4457b8c37b2ad579705c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:43Z,use_quota=True,user_id='c4d78191c6594c2a85e280173d2113b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] Creating volume e9a2f5a1-51f7-4308-a1e0-cdabf737d581 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:02:43 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e9a2f5a1-51f7-4308-a1e0-cdabf737d581 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:43 devstack sudo[104790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e9a2f5a1-51f7-4308-a1e0-cdabf737d581 1073741824
Nov 05 10:02:43 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4cbf9f56-d5cf-4a97-b444-85641938bfd1 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-2ec85757-b876-47c8-8e90-62fcf5e31618-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4cbf9f56-d5cf-4a97-b444-85641938bfd1 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-2ec85757-b876-47c8-8e90-62fcf5e31618-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4cbf9f56-d5cf-4a97-b444-85641938bfd1 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-quobyte-3537280c-cb56-4b62-84b1-a779bba4d49d" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4cbf9f56-d5cf-4a97-b444-85641938bfd1 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-3537280c-cb56-4b62-84b1-a779bba4d49d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4cbf9f56-d5cf-4a97-b444-85641938bfd1 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-quobyte-2ec85757-b876-47c8-8e90-62fcf5e31618" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:43 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4cbf9f56-d5cf-4a97-b444-85641938bfd1 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-2ec85757-b876-47c8-8e90-62fcf5e31618" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-4cbf9f56-d5cf-4a97-b444-85641938bfd1 tempest-ProjectMemberTests-1394267937 None] Deleting offline snapshot 2ec85757-b876-47c8-8e90-62fcf5e31618 of volume 3537280c-cb56-4b62-84b1-a779bba4d49d {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-4cbf9f56-d5cf-4a97-b444-85641938bfd1 tempest-ProjectMemberTests-1394267937 None] snapshot_file for this snap is: volume-3537280c-cb56-4b62-84b1-a779bba4d49d.2ec85757-b876-47c8-8e90-62fcf5e31618 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9ea9bdfd-bc9a-49ab-af89-38ed76dee231 tempest-ProjectReaderTests-1925760580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd" returned: 0 in 0.449s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9ea9bdfd-bc9a-49ab-af89-38ed76dee231 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[da99f5a8-0e55-4c37-bf96-49718b5059f0]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cbf9f56-d5cf-4a97-b444-85641938bfd1 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d.2ec85757-b876-47c8-8e90-62fcf5e31618 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:43 devstack sudo[104795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd
Nov 05 10:02:43 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:43 devstack sudo[104798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d.2ec85757-b876-47c8-8e90-62fcf5e31618
Nov 05 10:02:43 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:43 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e9a2f5a1-51f7-4308-a1e0-cdabf737d581 1073741824" returned: 0 in 0.517s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:43 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e9a2f5a1-51f7-4308-a1e0-cdabf737d581 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9ea9bdfd-bc9a-49ab-af89-38ed76dee231 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-5fdffdb4-1a78-4664-861c-d2416100d1bd" returned: 0 in 0.314s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9ea9bdfd-bc9a-49ab-af89-38ed76dee231 tempest-ProjectReaderTests-1925760580 None] Lock "cinder-quobyte-5fdffdb4-1a78-4664-861c-d2416100d1bd" released by "delete_volume" :: held 0.840s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:43 devstack sudo[104804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e9a2f5a1-51f7-4308-a1e0-cdabf737d581
Nov 05 10:02:43 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-9ea9bdfd-bc9a-49ab-af89-38ed76dee231 tempest-ProjectReaderTests-1925760580 None] Created reservations ['a10016c1-05fd-4842-aed7-aacb97b21b22', '469ab04e-495a-4122-8bae-a71286c037ea', '3a19492e-ad75-45b2-9824-39a01d7deea2', 'e166bd4e-95ca-43db-b93a-b51cb955e1f4'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9ea9bdfd-bc9a-49ab-af89-38ed76dee231 tempest-ProjectReaderTests-1925760580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9ea9bdfd-bc9a-49ab-af89-38ed76dee231 tempest-ProjectReaderTests-1925760580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:43 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9ea9bdfd-bc9a-49ab-af89-38ed76dee231 tempest-ProjectReaderTests-1925760580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-9ea9bdfd-bc9a-49ab-af89-38ed76dee231 tempest-ProjectReaderTests-1925760580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9ea9bdfd-bc9a-49ab-af89-38ed76dee231 tempest-ProjectReaderTests-1925760580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9ea9bdfd-bc9a-49ab-af89-38ed76dee231 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cbf9f56-d5cf-4a97-b444-85641938bfd1 tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d.2ec85757-b876-47c8-8e90-62fcf5e31618" returned: 0 in 0.472s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-4cbf9f56-d5cf-4a97-b444-85641938bfd1 tempest-ProjectMemberTests-1394267937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3537280c-cb56-4b62-84b1-a779bba4d49d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 10:02:43 devstack sudo[104809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:02:43 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8cf022-9010-49fc-afc4-011b16495b9b]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cbf9f56-d5cf-4a97-b444-85641938bfd1 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:44 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e9a2f5a1-51f7-4308-a1e0-cdabf737d581" returned: 0 in 0.322s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0538fff-0d37-48a8-882a-75c76404e246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9a2f5a1-51f7-4308-a1e0-cdabf737d581', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07298247-ba8c-498f-8d15-7e6a678ec507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:44 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] Volume volume-e9a2f5a1-51f7-4308-a1e0-cdabf737d581 (e9a2f5a1-51f7-4308-a1e0-cdabf737d581): created successfully
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07298247-ba8c-498f-8d15-7e6a678ec507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] Flow 'volume_create_manager' (34f9c11f-dcb7-46e8-b00c-a6a895a9677b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:44 devstack sudo[104812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d
Nov 05 10:02:44 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:44 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-bcfae26c-96b4-453b-8739-800a09e6add3 tempest-ProjectReaderTests-1618806998 None] Created volume successfully.
Nov 05 10:02:44 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9ea9bdfd-bc9a-49ab-af89-38ed76dee231 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.295s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-9ea9bdfd-bc9a-49ab-af89-38ed76dee231 tempest-ProjectReaderTests-1925760580 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:02:44 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-9ea9bdfd-bc9a-49ab-af89-38ed76dee231 tempest-ProjectReaderTests-1925760580 None] Deleted volume successfully.
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-9ea9bdfd-bc9a-49ab-af89-38ed76dee231 tempest-ProjectReaderTests-1925760580 None] Lock "cinder-5fdffdb4-1a78-4664-861c-d2416100d1bd-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:44 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cbf9f56-d5cf-4a97-b444-85641938bfd1 tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d" returned: 0 in 0.444s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cbf9f56-d5cf-4a97-b444-85641938bfd1 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d.2ec85757-b876-47c8-8e90-62fcf5e31618 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:44 devstack sudo[104818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d.2ec85757-b876-47c8-8e90-62fcf5e31618
Nov 05 10:02:44 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] Flow 'volume_create_manager' (47fd0f83-fd23-4002-aff0-fc8a4dd46756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc4d30f-938c-4bf8-91ca-23fe6352df38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc4d30f-938c-4bf8-91ca-23fe6352df38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-364376203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b8be1b-e11e-4173-b997-ad5c43e77415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4c116ececd45e4b5529b715e3cb8f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:45Z,use_quota=True,user_id='0741a898ad034e74aef7144bf4cc9ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6960237-5839-432d-8821-28e761a868b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6960237-5839-432d-8821-28e761a868b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b1a047-a214-453c-ad1d-3b24c38607d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b1a047-a214-453c-ad1d-3b24c38607d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32b8be1b-e11e-4173-b997-ad5c43e77415', 'volume_name': 'volume-32b8be1b-e11e-4173-b997-ad5c43e77415', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3505c11-0662-4cda-862c-52ef01c86e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3505c11-0662-4cda-862c-52ef01c86e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e31bb27f-2973-4ec0-8cbe-c421470fa6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:44 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] Volume 32b8be1b-e11e-4173-b997-ad5c43e77415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32b8be1b-e11e-4173-b997-ad5c43e77415', 'volume_size': 1}
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-364376203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b8be1b-e11e-4173-b997-ad5c43e77415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4c116ececd45e4b5529b715e3cb8f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:45Z,use_quota=True,user_id='0741a898ad034e74aef7144bf4cc9ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] Creating volume 32b8be1b-e11e-4173-b997-ad5c43e77415 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:02:44 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:44 devstack sudo[104822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415 1073741824
Nov 05 10:02:44 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:44 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cbf9f56-d5cf-4a97-b444-85641938bfd1 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d.2ec85757-b876-47c8-8e90-62fcf5e31618" returned: 0 in 0.360s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cbf9f56-d5cf-4a97-b444-85641938bfd1 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d.2ec85757-b876-47c8-8e90-62fcf5e31618 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:44 devstack sudo[104825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d.2ec85757-b876-47c8-8e90-62fcf5e31618
Nov 05 10:02:44 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:45 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-4cbf9f56-d5cf-4a97-b444-85641938bfd1 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d.2ec85757-b876-47c8-8e90-62fcf5e31618" returned: 0 in 0.292s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:45 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415 1073741824" returned: 0 in 0.475s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4cbf9f56-d5cf-4a97-b444-85641938bfd1 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-2ec85757-b876-47c8-8e90-62fcf5e31618" released by "_delete_snapshot" :: held 1.729s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4cbf9f56-d5cf-4a97-b444-85641938bfd1 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-3537280c-cb56-4b62-84b1-a779bba4d49d" released by "delete_snapshot" :: held 1.764s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:45 devstack sudo[104832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415
Nov 05 10:02:45 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bc49eeca-7bf9-4c17-a700-777e79de8aca tempest-ProjectReaderTests-1618806998 None] Acquiring lock "cinder-e9a2f5a1-51f7-4308-a1e0-cdabf737d581-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:45 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-4cbf9f56-d5cf-4a97-b444-85641938bfd1 tempest-ProjectMemberTests-1394267937 None] Created reservations ['c6a347ae-e69d-4870-b5f4-c4020f9fa05e', '291fc1c6-90d8-4947-95ad-29c1cea18daa', 'f87c7422-d63f-4824-9797-5be626f60bd5', '647c5da6-7741-4b04-8089-8ea0a3428c01'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:02:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bc49eeca-7bf9-4c17-a700-777e79de8aca tempest-ProjectReaderTests-1618806998 None] Lock "cinder-e9a2f5a1-51f7-4308-a1e0-cdabf737d581-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bc49eeca-7bf9-4c17-a700-777e79de8aca tempest-ProjectReaderTests-1618806998 None] Acquiring lock "cinder-quobyte-e9a2f5a1-51f7-4308-a1e0-cdabf737d581" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bc49eeca-7bf9-4c17-a700-777e79de8aca tempest-ProjectReaderTests-1618806998 None] Lock "cinder-quobyte-e9a2f5a1-51f7-4308-a1e0-cdabf737d581" acquired by "delete_volume" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:45 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-4cbf9f56-d5cf-4a97-b444-85641938bfd1 tempest-ProjectMemberTests-1394267937 None] Delete snapshot completed successfully.
Nov 05 10:02:45 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b94911-c635-4794-9e3a-81a2a1321023]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bc49eeca-7bf9-4c17-a700-777e79de8aca tempest-ProjectReaderTests-1618806998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e9a2f5a1-51f7-4308-a1e0-cdabf737d581 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-4cbf9f56-d5cf-4a97-b444-85641938bfd1 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-2ec85757-b876-47c8-8e90-62fcf5e31618-delete_snapshot" released by "delete_snapshot" :: held 2.019s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:45 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415" returned: 0 in 0.299s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:02:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:45 devstack sudo[104834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e9a2f5a1-51f7-4308-a1e0-cdabf737d581
Nov 05 10:02:45 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e31bb27f-2973-4ec0-8cbe-c421470fa6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32b8be1b-e11e-4173-b997-ad5c43e77415', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24387d9d-0f72-4af2-9255-b12e8295111d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:45 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] Volume volume-32b8be1b-e11e-4173-b997-ad5c43e77415 (32b8be1b-e11e-4173-b997-ad5c43e77415): created successfully
Nov 05 10:02:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24387d9d-0f72-4af2-9255-b12e8295111d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:45 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] Flow 'volume_create_manager' (47fd0f83-fd23-4002-aff0-fc8a4dd46756) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:45 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-de341eff-fbdf-407d-8ab3-94a6b6609a23 tempest-ProjectReaderTests-1925760580 None] Created volume successfully.
Nov 05 10:02:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a5e23a83-9f80-414d-a4d7-72ced2dc95d6 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-3537280c-cb56-4b62-84b1-a779bba4d49d-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a5e23a83-9f80-414d-a4d7-72ced2dc95d6 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-3537280c-cb56-4b62-84b1-a779bba4d49d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a5e23a83-9f80-414d-a4d7-72ced2dc95d6 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-quobyte-3537280c-cb56-4b62-84b1-a779bba4d49d" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:45 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a5e23a83-9f80-414d-a4d7-72ced2dc95d6 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-3537280c-cb56-4b62-84b1-a779bba4d49d" acquired by "delete_volume" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:45 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a14b3bb-0084-43b0-b656-e38fe7bcc515]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a5e23a83-9f80-414d-a4d7-72ced2dc95d6 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:45 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bc49eeca-7bf9-4c17-a700-777e79de8aca tempest-ProjectReaderTests-1618806998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e9a2f5a1-51f7-4308-a1e0-cdabf737d581" returned: 0 in 0.408s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bc49eeca-7bf9-4c17-a700-777e79de8aca tempest-ProjectReaderTests-1618806998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e9a2f5a1-51f7-4308-a1e0-cdabf737d581 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:45 devstack sudo[104841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e9a2f5a1-51f7-4308-a1e0-cdabf737d581
Nov 05 10:02:45 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:45 devstack sudo[104840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d
Nov 05 10:02:45 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:46 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bc49eeca-7bf9-4c17-a700-777e79de8aca tempest-ProjectReaderTests-1618806998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-e9a2f5a1-51f7-4308-a1e0-cdabf737d581" returned: 0 in 0.253s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bc49eeca-7bf9-4c17-a700-777e79de8aca tempest-ProjectReaderTests-1618806998 None] Lock "cinder-quobyte-e9a2f5a1-51f7-4308-a1e0-cdabf737d581" released by "delete_volume" :: held 0.709s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:46 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-bc49eeca-7bf9-4c17-a700-777e79de8aca tempest-ProjectReaderTests-1618806998 None] Created reservations ['9cb4b941-1703-49ab-bd21-0af34f1c9e14', '64e50b44-ba64-40d5-93e7-2c024ba606e6', '7df37582-000b-49dd-adb4-3f4bd4e8cf9d', 'dbe03c81-366f-414a-99de-37db0595bda1'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:02:46 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a5e23a83-9f80-414d-a4d7-72ced2dc95d6 tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d" returned: 0 in 0.380s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a5e23a83-9f80-414d-a4d7-72ced2dc95d6 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:46 devstack sudo[104848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d
Nov 05 10:02:46 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bc49eeca-7bf9-4c17-a700-777e79de8aca tempest-ProjectReaderTests-1618806998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bc49eeca-7bf9-4c17-a700-777e79de8aca tempest-ProjectReaderTests-1618806998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-bc49eeca-7bf9-4c17-a700-777e79de8aca tempest-ProjectReaderTests-1618806998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-bc49eeca-7bf9-4c17-a700-777e79de8aca tempest-ProjectReaderTests-1618806998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-bc49eeca-7bf9-4c17-a700-777e79de8aca tempest-ProjectReaderTests-1618806998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bc49eeca-7bf9-4c17-a700-777e79de8aca tempest-ProjectReaderTests-1618806998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:46 devstack sudo[104850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:02:46 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:46 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a5e23a83-9f80-414d-a4d7-72ced2dc95d6 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-3537280c-cb56-4b62-84b1-a779bba4d49d" returned: 0 in 0.275s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a5e23a83-9f80-414d-a4d7-72ced2dc95d6 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-3537280c-cb56-4b62-84b1-a779bba4d49d" released by "delete_volume" :: held 0.732s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:46 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-bc49eeca-7bf9-4c17-a700-777e79de8aca tempest-ProjectReaderTests-1618806998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.272s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:46 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-bc49eeca-7bf9-4c17-a700-777e79de8aca tempest-ProjectReaderTests-1618806998 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:02:46 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-bc49eeca-7bf9-4c17-a700-777e79de8aca tempest-ProjectReaderTests-1618806998 None] Deleted volume successfully.
Nov 05 10:02:46 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-a5e23a83-9f80-414d-a4d7-72ced2dc95d6 tempest-ProjectMemberTests-1394267937 None] Created reservations ['f5547d07-a7e2-4273-a5b8-5996788592b5', '7163bac6-57d4-4abd-a35a-ae4e77b797dc', '782d9d9a-b417-4936-86a0-2305ca37ebe7', '22731ab3-3bfe-45ca-99b3-7948d80272c3'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:02:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-bc49eeca-7bf9-4c17-a700-777e79de8aca tempest-ProjectReaderTests-1618806998 None] Lock "cinder-e9a2f5a1-51f7-4308-a1e0-cdabf737d581-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a5e23a83-9f80-414d-a4d7-72ced2dc95d6 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a5e23a83-9f80-414d-a4d7-72ced2dc95d6 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a5e23a83-9f80-414d-a4d7-72ced2dc95d6 tempest-ProjectMemberTests-1394267937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-a5e23a83-9f80-414d-a4d7-72ced2dc95d6 tempest-ProjectMemberTests-1394267937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-a5e23a83-9f80-414d-a4d7-72ced2dc95d6 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a5e23a83-9f80-414d-a4d7-72ced2dc95d6 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:46 devstack sudo[104854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:02:46 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:46 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-a5e23a83-9f80-414d-a4d7-72ced2dc95d6 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.337s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:46 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-a5e23a83-9f80-414d-a4d7-72ced2dc95d6 tempest-ProjectMemberTests-1394267937 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:02:46 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-a5e23a83-9f80-414d-a4d7-72ced2dc95d6 tempest-ProjectMemberTests-1394267937 None] Deleted volume successfully.
Nov 05 10:02:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9e0f58e6-df23-4d4d-8e5a-f89696b4ecb0 tempest-ProjectReaderTests-1925760580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9e0f58e6-df23-4d4d-8e5a-f89696b4ecb0 tempest-ProjectReaderTests-1925760580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-a5e23a83-9f80-414d-a4d7-72ced2dc95d6 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-3537280c-cb56-4b62-84b1-a779bba4d49d-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-9e0f58e6-df23-4d4d-8e5a-f89696b4ecb0 tempest-ProjectReaderTests-1925760580 None] Creating offline snapshot 801502f1-4301-4139-bd6b-3f7cfec7fecc of volume 32b8be1b-e11e-4173-b997-ad5c43e77415 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 10:02:47 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4446e7-cef8-41b6-a66d-facee42cf62e]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9e0f58e6-df23-4d4d-8e5a-f89696b4ecb0 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:47 devstack sudo[104857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415
Nov 05 10:02:47 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:47 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:02:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] Flow 'volume_create_manager' (b4d1bfb8-75f3-46af-93c4-d5b9da698121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83adac6-9edc-4dbd-ad7a-607314a0c05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83adac6-9edc-4dbd-ad7a-607314a0c05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-443573783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d787be-1346-4ab3-bd68-dd6e961e6572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e528f8801a4697bc8112c19f08f0c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:47Z,use_quota=True,user_id='db806d37a63442189c00f5196322142a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9367938c-1eaf-4669-ae9b-3891cccc3ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9367938c-1eaf-4669-ae9b-3891cccc3ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f319d94f-918b-47c9-b6c5-e8598217a72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f319d94f-918b-47c9-b6c5-e8598217a72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6d787be-1346-4ab3-bd68-dd6e961e6572', 'volume_name': 'volume-c6d787be-1346-4ab3-bd68-dd6e961e6572', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0b97dd-2488-47f2-93ac-1bb1a5014de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0b97dd-2488-47f2-93ac-1bb1a5014de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:47 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b2ae44-ab62-4c07-972d-cf347cffe67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:47 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] Volume c6d787be-1346-4ab3-bd68-dd6e961e6572: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6d787be-1346-4ab3-bd68-dd6e961e6572', 'volume_size': 1}
Nov 05 10:02:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:47 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9e0f58e6-df23-4d4d-8e5a-f89696b4ecb0 tempest-ProjectReaderTests-1925760580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415" returned: 0 in 0.456s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9e0f58e6-df23-4d4d-8e5a-f89696b4ecb0 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415.801502f1-4301-4139-bd6b-3f7cfec7fecc 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:47 devstack sudo[104876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415.801502f1-4301-4139-bd6b-3f7cfec7fecc 1G
Nov 05 10:02:47 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:48 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9e0f58e6-df23-4d4d-8e5a-f89696b4ecb0 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415.801502f1-4301-4139-bd6b-3f7cfec7fecc 1G" returned: 0 in 0.510s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9e0f58e6-df23-4d4d-8e5a-f89696b4ecb0 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b8be1b-e11e-4173-b997-ad5c43e77415 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415.801502f1-4301-4139-bd6b-3f7cfec7fecc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:48 devstack sudo[104904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b8be1b-e11e-4173-b997-ad5c43e77415 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415.801502f1-4301-4139-bd6b-3f7cfec7fecc
Nov 05 10:02:48 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:48 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9e0f58e6-df23-4d4d-8e5a-f89696b4ecb0 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b8be1b-e11e-4173-b997-ad5c43e77415 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415.801502f1-4301-4139-bd6b-3f7cfec7fecc" returned: 0 in 0.337s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:48 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-9e0f58e6-df23-4d4d-8e5a-f89696b4ecb0 tempest-ProjectReaderTests-1925760580 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415.801502f1-4301-4139-bd6b-3f7cfec7fecc is being set with open permissions: ugo+rw
Nov 05 10:02:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9e0f58e6-df23-4d4d-8e5a-f89696b4ecb0 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415.801502f1-4301-4139-bd6b-3f7cfec7fecc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:48 devstack sudo[104909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415.801502f1-4301-4139-bd6b-3f7cfec7fecc
Nov 05 10:02:48 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:48 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9e0f58e6-df23-4d4d-8e5a-f89696b4ecb0 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415.801502f1-4301-4139-bd6b-3f7cfec7fecc" returned: 0 in 0.255s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9e0f58e6-df23-4d4d-8e5a-f89696b4ecb0 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:48 devstack sudo[104912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415.info
Nov 05 10:02:48 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:48 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9e0f58e6-df23-4d4d-8e5a-f89696b4ecb0 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415.info" returned: 0 in 0.271s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:48 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-9e0f58e6-df23-4d4d-8e5a-f89696b4ecb0 tempest-ProjectReaderTests-1925760580 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415.info is being set with open permissions: ugo+rw
Nov 05 10:02:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9e0f58e6-df23-4d4d-8e5a-f89696b4ecb0 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:48 devstack sudo[104915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415.info
Nov 05 10:02:48 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:49 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-9e0f58e6-df23-4d4d-8e5a-f89696b4ecb0 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415.info" returned: 0 in 0.246s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-9e0f58e6-df23-4d4d-8e5a-f89696b4ecb0 tempest-ProjectReaderTests-1925760580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.195s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.710s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-443573783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d787be-1346-4ab3-bd68-dd6e961e6572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e528f8801a4697bc8112c19f08f0c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:47Z,use_quota=True,user_id='db806d37a63442189c00f5196322142a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:02:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] Creating volume c6d787be-1346-4ab3-bd68-dd6e961e6572 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:02:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:02:49 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:02:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:49 devstack sudo[104918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572 1073741824
Nov 05 10:02:49 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:49 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-9e0f58e6-df23-4d4d-8e5a-f89696b4ecb0 tempest-ProjectReaderTests-1925760580 None] Create snapshot completed successfully
Nov 05 10:02:49 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572 1073741824" returned: 0 in 0.422s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:49 devstack sudo[104923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572
Nov 05 10:02:49 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:49 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572" returned: 0 in 0.248s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:02:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b2ae44-ab62-4c07-972d-cf347cffe67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6d787be-1346-4ab3-bd68-dd6e961e6572', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fdc9664-80fe-4d96-822d-d3def25b3462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:49 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] Volume volume-c6d787be-1346-4ab3-bd68-dd6e961e6572 (c6d787be-1346-4ab3-bd68-dd6e961e6572): created successfully
Nov 05 10:02:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fdc9664-80fe-4d96-822d-d3def25b3462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:49 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] Flow 'volume_create_manager' (b4d1bfb8-75f3-46af-93c4-d5b9da698121) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:49 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-08807a9c-667b-4dae-882c-9539c85468c5 tempest-ProjectMemberTests-1394267937 None] Created volume successfully.
Nov 05 10:02:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0b90b234-9d7b-4c26-bcf7-3b99b1b6e18e tempest-ProjectReaderTests-1925760580 None] Acquiring lock "cinder-801502f1-4301-4139-bd6b-3f7cfec7fecc-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0b90b234-9d7b-4c26-bcf7-3b99b1b6e18e tempest-ProjectReaderTests-1925760580 None] Lock "cinder-801502f1-4301-4139-bd6b-3f7cfec7fecc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0b90b234-9d7b-4c26-bcf7-3b99b1b6e18e tempest-ProjectReaderTests-1925760580 None] Acquiring lock "cinder-quobyte-32b8be1b-e11e-4173-b997-ad5c43e77415" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0b90b234-9d7b-4c26-bcf7-3b99b1b6e18e tempest-ProjectReaderTests-1925760580 None] Lock "cinder-quobyte-32b8be1b-e11e-4173-b997-ad5c43e77415" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0b90b234-9d7b-4c26-bcf7-3b99b1b6e18e tempest-ProjectReaderTests-1925760580 None] Acquiring lock "cinder-quobyte-801502f1-4301-4139-bd6b-3f7cfec7fecc" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:50 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0b90b234-9d7b-4c26-bcf7-3b99b1b6e18e tempest-ProjectReaderTests-1925760580 None] Lock "cinder-quobyte-801502f1-4301-4139-bd6b-3f7cfec7fecc" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-0b90b234-9d7b-4c26-bcf7-3b99b1b6e18e tempest-ProjectReaderTests-1925760580 None] Deleting offline snapshot 801502f1-4301-4139-bd6b-3f7cfec7fecc of volume 32b8be1b-e11e-4173-b997-ad5c43e77415 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 10:02:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-0b90b234-9d7b-4c26-bcf7-3b99b1b6e18e tempest-ProjectReaderTests-1925760580 None] snapshot_file for this snap is: volume-32b8be1b-e11e-4173-b997-ad5c43e77415.801502f1-4301-4139-bd6b-3f7cfec7fecc {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 10:02:50 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9134e1e-17e2-442c-89da-31fdc63f2233]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0b90b234-9d7b-4c26-bcf7-3b99b1b6e18e tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415.801502f1-4301-4139-bd6b-3f7cfec7fecc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:50 devstack sudo[104927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415.801502f1-4301-4139-bd6b-3f7cfec7fecc
Nov 05 10:02:50 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:50 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0b90b234-9d7b-4c26-bcf7-3b99b1b6e18e tempest-ProjectReaderTests-1925760580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415.801502f1-4301-4139-bd6b-3f7cfec7fecc" returned: 0 in 0.371s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-0b90b234-9d7b-4c26-bcf7-3b99b1b6e18e tempest-ProjectReaderTests-1925760580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32b8be1b-e11e-4173-b997-ad5c43e77415(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 10:02:50 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43bd699-4483-4d7e-a929-5dd295447228]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0b90b234-9d7b-4c26-bcf7-3b99b1b6e18e tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2e1d950d-a25f-4073-a7aa-ba5306653965 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2e1d950d-a25f-4073-a7aa-ba5306653965 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:50 devstack sudo[104933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415
Nov 05 10:02:50 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-2e1d950d-a25f-4073-a7aa-ba5306653965 tempest-ProjectMemberTests-1394267937 None] Creating offline snapshot e93eae56-25e5-4f0b-b94f-785666aac932 of volume c6d787be-1346-4ab3-bd68-dd6e961e6572 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 10:02:50 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda20519-81aa-482b-a03e-a1775bb53b63]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e1d950d-a25f-4073-a7aa-ba5306653965 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:50 devstack sudo[104935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572
Nov 05 10:02:50 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:50 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0b90b234-9d7b-4c26-bcf7-3b99b1b6e18e tempest-ProjectReaderTests-1925760580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415" returned: 0 in 0.396s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0b90b234-9d7b-4c26-bcf7-3b99b1b6e18e tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415.801502f1-4301-4139-bd6b-3f7cfec7fecc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:51 devstack sudo[104940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415.801502f1-4301-4139-bd6b-3f7cfec7fecc
Nov 05 10:02:51 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:51 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e1d950d-a25f-4073-a7aa-ba5306653965 tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572" returned: 0 in 0.374s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e1d950d-a25f-4073-a7aa-ba5306653965 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572.e93eae56-25e5-4f0b-b94f-785666aac932 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:51 devstack sudo[104945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572.e93eae56-25e5-4f0b-b94f-785666aac932 1G
Nov 05 10:02:51 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:51 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0b90b234-9d7b-4c26-bcf7-3b99b1b6e18e tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415.801502f1-4301-4139-bd6b-3f7cfec7fecc" returned: 0 in 0.348s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0b90b234-9d7b-4c26-bcf7-3b99b1b6e18e tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415.801502f1-4301-4139-bd6b-3f7cfec7fecc {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:51 devstack sudo[104950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415.801502f1-4301-4139-bd6b-3f7cfec7fecc
Nov 05 10:02:51 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:51 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e1d950d-a25f-4073-a7aa-ba5306653965 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572.e93eae56-25e5-4f0b-b94f-785666aac932 1G" returned: 0 in 0.428s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e1d950d-a25f-4073-a7aa-ba5306653965 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6d787be-1346-4ab3-bd68-dd6e961e6572 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572.e93eae56-25e5-4f0b-b94f-785666aac932 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:51 devstack sudo[104956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6d787be-1346-4ab3-bd68-dd6e961e6572 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572.e93eae56-25e5-4f0b-b94f-785666aac932
Nov 05 10:02:51 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:51 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0b90b234-9d7b-4c26-bcf7-3b99b1b6e18e tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415.801502f1-4301-4139-bd6b-3f7cfec7fecc" returned: 0 in 0.279s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0b90b234-9d7b-4c26-bcf7-3b99b1b6e18e tempest-ProjectReaderTests-1925760580 None] Lock "cinder-quobyte-801502f1-4301-4139-bd6b-3f7cfec7fecc" released by "_delete_snapshot" :: held 1.512s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0b90b234-9d7b-4c26-bcf7-3b99b1b6e18e tempest-ProjectReaderTests-1925760580 None] Lock "cinder-quobyte-32b8be1b-e11e-4173-b997-ad5c43e77415" released by "delete_snapshot" :: held 1.535s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:51 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-0b90b234-9d7b-4c26-bcf7-3b99b1b6e18e tempest-ProjectReaderTests-1925760580 None] Created reservations ['bb54db35-241a-4652-9bf9-f12a96892edb', 'd54c968d-9db3-4de2-8306-a818f01d5968', 'e53fa9c0-4e9b-4eec-866d-264040cc1a30', '3e6fec3e-cccb-4f4b-a790-620dd9c7b745'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:02:51 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-0b90b234-9d7b-4c26-bcf7-3b99b1b6e18e tempest-ProjectReaderTests-1925760580 None] Delete snapshot completed successfully.
Nov 05 10:02:51 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-0b90b234-9d7b-4c26-bcf7-3b99b1b6e18e tempest-ProjectReaderTests-1925760580 None] Lock "cinder-801502f1-4301-4139-bd6b-3f7cfec7fecc-delete_snapshot" released by "delete_snapshot" :: held 1.687s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:51 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e1d950d-a25f-4073-a7aa-ba5306653965 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6d787be-1346-4ab3-bd68-dd6e961e6572 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572.e93eae56-25e5-4f0b-b94f-785666aac932" returned: 0 in 0.302s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:51 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-2e1d950d-a25f-4073-a7aa-ba5306653965 tempest-ProjectMemberTests-1394267937 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572.e93eae56-25e5-4f0b-b94f-785666aac932 is being set with open permissions: ugo+rw
Nov 05 10:02:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e1d950d-a25f-4073-a7aa-ba5306653965 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572.e93eae56-25e5-4f0b-b94f-785666aac932 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:51 devstack sudo[104961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572.e93eae56-25e5-4f0b-b94f-785666aac932
Nov 05 10:02:51 devstack sudo[104961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:52 devstack sudo[104961]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e1d950d-a25f-4073-a7aa-ba5306653965 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572.e93eae56-25e5-4f0b-b94f-785666aac932" returned: 0 in 0.241s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e1d950d-a25f-4073-a7aa-ba5306653965 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:52 devstack sudo[104964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572.info
Nov 05 10:02:52 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-eaea5fb6-b82a-4a1c-84ff-305603eedeeb tempest-ProjectReaderTests-1925760580 None] Acquiring lock "cinder-32b8be1b-e11e-4173-b997-ad5c43e77415-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-eaea5fb6-b82a-4a1c-84ff-305603eedeeb tempest-ProjectReaderTests-1925760580 None] Lock "cinder-32b8be1b-e11e-4173-b997-ad5c43e77415-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-eaea5fb6-b82a-4a1c-84ff-305603eedeeb tempest-ProjectReaderTests-1925760580 None] Acquiring lock "cinder-quobyte-32b8be1b-e11e-4173-b997-ad5c43e77415" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-eaea5fb6-b82a-4a1c-84ff-305603eedeeb tempest-ProjectReaderTests-1925760580 None] Lock "cinder-quobyte-32b8be1b-e11e-4173-b997-ad5c43e77415" acquired by "delete_volume" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:52 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[45278e21-e96e-4468-9b18-f42824bfad74]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eaea5fb6-b82a-4a1c-84ff-305603eedeeb tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:52 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e1d950d-a25f-4073-a7aa-ba5306653965 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572.info" returned: 0 in 0.267s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:52 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-2e1d950d-a25f-4073-a7aa-ba5306653965 tempest-ProjectMemberTests-1394267937 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572.info is being set with open permissions: ugo+rw
Nov 05 10:02:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e1d950d-a25f-4073-a7aa-ba5306653965 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:52 devstack sudo[104968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572.info
Nov 05 10:02:52 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:52 devstack sudo[104967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415
Nov 05 10:02:52 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:52 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2e1d950d-a25f-4073-a7aa-ba5306653965 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572.info" returned: 0 in 0.263s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2e1d950d-a25f-4073-a7aa-ba5306653965 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.968s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:52 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-2e1d950d-a25f-4073-a7aa-ba5306653965 tempest-ProjectMemberTests-1394267937 None] Create snapshot completed successfully
Nov 05 10:02:52 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eaea5fb6-b82a-4a1c-84ff-305603eedeeb tempest-ProjectReaderTests-1925760580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415" returned: 0 in 0.386s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eaea5fb6-b82a-4a1c-84ff-305603eedeeb tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:52 devstack sudo[104975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415
Nov 05 10:02:52 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cc8bf2ca-1fe3-4737-884d-3dd2af5a0b91 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-e93eae56-25e5-4f0b-b94f-785666aac932-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cc8bf2ca-1fe3-4737-884d-3dd2af5a0b91 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-e93eae56-25e5-4f0b-b94f-785666aac932-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cc8bf2ca-1fe3-4737-884d-3dd2af5a0b91 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-quobyte-c6d787be-1346-4ab3-bd68-dd6e961e6572" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cc8bf2ca-1fe3-4737-884d-3dd2af5a0b91 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-c6d787be-1346-4ab3-bd68-dd6e961e6572" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cc8bf2ca-1fe3-4737-884d-3dd2af5a0b91 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-quobyte-e93eae56-25e5-4f0b-b94f-785666aac932" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:52 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cc8bf2ca-1fe3-4737-884d-3dd2af5a0b91 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-e93eae56-25e5-4f0b-b94f-785666aac932" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-cc8bf2ca-1fe3-4737-884d-3dd2af5a0b91 tempest-ProjectMemberTests-1394267937 None] Deleting offline snapshot e93eae56-25e5-4f0b-b94f-785666aac932 of volume c6d787be-1346-4ab3-bd68-dd6e961e6572 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 10:02:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-cc8bf2ca-1fe3-4737-884d-3dd2af5a0b91 tempest-ProjectMemberTests-1394267937 None] snapshot_file for this snap is: volume-c6d787be-1346-4ab3-bd68-dd6e961e6572.e93eae56-25e5-4f0b-b94f-785666aac932 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 10:02:52 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1f85c8-97ec-459a-9524-37c63b398c27]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cc8bf2ca-1fe3-4737-884d-3dd2af5a0b91 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572.e93eae56-25e5-4f0b-b94f-785666aac932 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:53 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eaea5fb6-b82a-4a1c-84ff-305603eedeeb tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-32b8be1b-e11e-4173-b997-ad5c43e77415" returned: 0 in 0.264s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-eaea5fb6-b82a-4a1c-84ff-305603eedeeb tempest-ProjectReaderTests-1925760580 None] Lock "cinder-quobyte-32b8be1b-e11e-4173-b997-ad5c43e77415" released by "delete_volume" :: held 0.713s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:53 devstack sudo[104977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572.e93eae56-25e5-4f0b-b94f-785666aac932
Nov 05 10:02:53 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:53 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-eaea5fb6-b82a-4a1c-84ff-305603eedeeb tempest-ProjectReaderTests-1925760580 None] Created reservations ['2437a780-9bce-455e-90f7-c59a77f0a18a', '42d16a27-f421-40f8-86ac-2f54cc46d4fc', '7c8df6a7-9c87-47ba-8990-32cc93d7fbeb', '81937eb4-3b36-4b07-b503-da0715d9bfe2'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:02:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-eaea5fb6-b82a-4a1c-84ff-305603eedeeb tempest-ProjectReaderTests-1925760580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-eaea5fb6-b82a-4a1c-84ff-305603eedeeb tempest-ProjectReaderTests-1925760580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-eaea5fb6-b82a-4a1c-84ff-305603eedeeb tempest-ProjectReaderTests-1925760580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-eaea5fb6-b82a-4a1c-84ff-305603eedeeb tempest-ProjectReaderTests-1925760580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-eaea5fb6-b82a-4a1c-84ff-305603eedeeb tempest-ProjectReaderTests-1925760580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eaea5fb6-b82a-4a1c-84ff-305603eedeeb tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:53 devstack sudo[104980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:02:53 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:53 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cc8bf2ca-1fe3-4737-884d-3dd2af5a0b91 tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572.e93eae56-25e5-4f0b-b94f-785666aac932" returned: 0 in 0.381s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:53 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-cc8bf2ca-1fe3-4737-884d-3dd2af5a0b91 tempest-ProjectMemberTests-1394267937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6d787be-1346-4ab3-bd68-dd6e961e6572(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 10:02:53 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bd9f2e-374e-413a-b7c3-ade81bbe7858]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cc8bf2ca-1fe3-4737-884d-3dd2af5a0b91 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:53 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eaea5fb6-b82a-4a1c-84ff-305603eedeeb tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.276s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:53 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-eaea5fb6-b82a-4a1c-84ff-305603eedeeb tempest-ProjectReaderTests-1925760580 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:02:53 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-eaea5fb6-b82a-4a1c-84ff-305603eedeeb tempest-ProjectReaderTests-1925760580 None] Deleted volume successfully.
Nov 05 10:02:53 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-eaea5fb6-b82a-4a1c-84ff-305603eedeeb tempest-ProjectReaderTests-1925760580 None] Lock "cinder-32b8be1b-e11e-4173-b997-ad5c43e77415-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:53 devstack sudo[104985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572
Nov 05 10:02:53 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:53 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cc8bf2ca-1fe3-4737-884d-3dd2af5a0b91 tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572" returned: 0 in 0.409s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cc8bf2ca-1fe3-4737-884d-3dd2af5a0b91 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572.e93eae56-25e5-4f0b-b94f-785666aac932 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:53 devstack sudo[104991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572.e93eae56-25e5-4f0b-b94f-785666aac932
Nov 05 10:02:53 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:53 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:02:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] Flow 'volume_create_manager' (46bf7277-e0d7-418f-8fbb-ed451caf1748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:53 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bee30f0-acb6-41ad-9098-a5c577f2c81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bee30f0-acb6-41ad-9098-a5c577f2c81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1182717732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0ff486b-d6bd-412e-a4a1-249d24caa18d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4c116ececd45e4b5529b715e3cb8f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:54Z,use_quota=True,user_id='0741a898ad034e74aef7144bf4cc9ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a8ea33f-58ac-4fcf-8da1-5db6f97dcd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a8ea33f-58ac-4fcf-8da1-5db6f97dcd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da38075e-eafd-49a4-adc8-399621824d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da38075e-eafd-49a4-adc8-399621824d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0ff486b-d6bd-412e-a4a1-249d24caa18d', 'volume_name': 'volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a77a2e-f9b2-425e-bf4f-3603f820b292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a77a2e-f9b2-425e-bf4f-3603f820b292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28eb2ab4-d2bf-4ead-824b-c47222da44ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:54 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] Volume f0ff486b-d6bd-412e-a4a1-249d24caa18d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d', 'volume_size': 1}
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1182717732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0ff486b-d6bd-412e-a4a1-249d24caa18d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4c116ececd45e4b5529b715e3cb8f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:54Z,use_quota=True,user_id='0741a898ad034e74aef7144bf4cc9ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] Creating volume f0ff486b-d6bd-412e-a4a1-249d24caa18d {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:02:54 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:54 devstack sudo[104996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d 1073741824
Nov 05 10:02:54 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:54 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cc8bf2ca-1fe3-4737-884d-3dd2af5a0b91 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572.e93eae56-25e5-4f0b-b94f-785666aac932" returned: 0 in 0.352s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cc8bf2ca-1fe3-4737-884d-3dd2af5a0b91 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572.e93eae56-25e5-4f0b-b94f-785666aac932 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:54 devstack sudo[104998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572.e93eae56-25e5-4f0b-b94f-785666aac932
Nov 05 10:02:54 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:54 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cc8bf2ca-1fe3-4737-884d-3dd2af5a0b91 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572.e93eae56-25e5-4f0b-b94f-785666aac932" returned: 0 in 0.269s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cc8bf2ca-1fe3-4737-884d-3dd2af5a0b91 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-e93eae56-25e5-4f0b-b94f-785666aac932" released by "_delete_snapshot" :: held 1.532s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cc8bf2ca-1fe3-4737-884d-3dd2af5a0b91 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-c6d787be-1346-4ab3-bd68-dd6e961e6572" released by "delete_snapshot" :: held 1.556s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:54 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d 1073741824" returned: 0 in 0.433s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-cc8bf2ca-1fe3-4737-884d-3dd2af5a0b91 tempest-ProjectMemberTests-1394267937 None] Created reservations ['438ecdb9-11bc-4c46-843d-a4c9fd4994d5', 'b9ca6377-8120-41af-9dd4-a08628824620', '7137010d-9d17-42e0-b5ed-89f6e8faaa21', '8db44f73-508a-4541-b63c-246efe0cc2d6'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:02:54 devstack sudo[105005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d
Nov 05 10:02:54 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:54 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-cc8bf2ca-1fe3-4737-884d-3dd2af5a0b91 tempest-ProjectMemberTests-1394267937 None] Delete snapshot completed successfully.
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-cc8bf2ca-1fe3-4737-884d-3dd2af5a0b91 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-e93eae56-25e5-4f0b-b94f-785666aac932-delete_snapshot" released by "delete_snapshot" :: held 1.798s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:54 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d" returned: 0 in 0.271s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28eb2ab4-d2bf-4ead-824b-c47222da44ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a4d77aa-dd55-4d8a-b955-853cf8c52ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:54 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] Volume volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d (f0ff486b-d6bd-412e-a4a1-249d24caa18d): created successfully
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a4d77aa-dd55-4d8a-b955-853cf8c52ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:54 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] Flow 'volume_create_manager' (46bf7277-e0d7-418f-8fbb-ed451caf1748) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:54 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-796d42fb-7e80-42fc-b4e6-44e918843ad3 tempest-ProjectReaderTests-1925760580 None] Created volume successfully.
Nov 05 10:02:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-23c81c90-2767-4992-ab7e-4dbfd857e256 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-c6d787be-1346-4ab3-bd68-dd6e961e6572-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-23c81c90-2767-4992-ab7e-4dbfd857e256 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-c6d787be-1346-4ab3-bd68-dd6e961e6572-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-23c81c90-2767-4992-ab7e-4dbfd857e256 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-quobyte-c6d787be-1346-4ab3-bd68-dd6e961e6572" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-23c81c90-2767-4992-ab7e-4dbfd857e256 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-c6d787be-1346-4ab3-bd68-dd6e961e6572" acquired by "delete_volume" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:55 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[7466a2ea-947f-455b-a88d-ac823a0dc7db]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23c81c90-2767-4992-ab7e-4dbfd857e256 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:55 devstack sudo[105008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572
Nov 05 10:02:55 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:55 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23c81c90-2767-4992-ab7e-4dbfd857e256 tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572" returned: 0 in 0.385s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23c81c90-2767-4992-ab7e-4dbfd857e256 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:55 devstack sudo[105013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572
Nov 05 10:02:55 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:55 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23c81c90-2767-4992-ab7e-4dbfd857e256 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-c6d787be-1346-4ab3-bd68-dd6e961e6572" returned: 0 in 0.271s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-23c81c90-2767-4992-ab7e-4dbfd857e256 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-c6d787be-1346-4ab3-bd68-dd6e961e6572" released by "delete_volume" :: held 0.716s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:55 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-23c81c90-2767-4992-ab7e-4dbfd857e256 tempest-ProjectMemberTests-1394267937 None] Created reservations ['12e25825-9e49-4aa8-a263-d9b8d2bc8fd0', '50166818-4848-4013-82ed-16d6e8b0c047', 'd2230645-3960-497c-8f8d-a40743883b8e', '8ea2c54b-ef9d-4340-ba9d-667ddfe66090'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:02:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-23c81c90-2767-4992-ab7e-4dbfd857e256 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-23c81c90-2767-4992-ab7e-4dbfd857e256 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-23c81c90-2767-4992-ab7e-4dbfd857e256 tempest-ProjectMemberTests-1394267937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-23c81c90-2767-4992-ab7e-4dbfd857e256 tempest-ProjectMemberTests-1394267937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-23c81c90-2767-4992-ab7e-4dbfd857e256 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23c81c90-2767-4992-ab7e-4dbfd857e256 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:55 devstack sudo[105016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:02:55 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b5d4522b-b099-477a-95c2-36e02a764216 tempest-ProjectReaderTests-1925760580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b5d4522b-b099-477a-95c2-36e02a764216 tempest-ProjectReaderTests-1925760580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:56 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-23c81c90-2767-4992-ab7e-4dbfd857e256 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.305s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:56 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-23c81c90-2767-4992-ab7e-4dbfd857e256 tempest-ProjectMemberTests-1394267937 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:02:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-b5d4522b-b099-477a-95c2-36e02a764216 tempest-ProjectReaderTests-1925760580 None] Creating offline snapshot 7a762787-0d39-49c2-a424-b1b0c7746814 of volume f0ff486b-d6bd-412e-a4a1-249d24caa18d {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 10:02:56 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-23c81c90-2767-4992-ab7e-4dbfd857e256 tempest-ProjectMemberTests-1394267937 None] Deleted volume successfully.
Nov 05 10:02:56 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8f14cd-42c8-4350-89be-960d52f8f3a6]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b5d4522b-b099-477a-95c2-36e02a764216 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:56 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-23c81c90-2767-4992-ab7e-4dbfd857e256 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-c6d787be-1346-4ab3-bd68-dd6e961e6572-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:02:56 devstack sudo[105019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d
Nov 05 10:02:56 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:56 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b5d4522b-b099-477a-95c2-36e02a764216 tempest-ProjectReaderTests-1925760580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d" returned: 0 in 0.425s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b5d4522b-b099-477a-95c2-36e02a764216 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d.7a762787-0d39-49c2-a424-b1b0c7746814 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:56 devstack sudo[105024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d.7a762787-0d39-49c2-a424-b1b0c7746814 1G
Nov 05 10:02:56 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:56 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:02:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] Flow 'volume_create_manager' (b12b433e-7f0a-4826-8255-68cba2920cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4117e1fa-bb3f-4e06-abf1-68b733629fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4117e1fa-bb3f-4e06-abf1-68b733629fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-4975919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed57b6cc-b645-4e0e-a558-a5ea8424ab4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e528f8801a4697bc8112c19f08f0c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:57Z,use_quota=True,user_id='db806d37a63442189c00f5196322142a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7dca57c-4d25-4691-97dd-cb1c062f5eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7dca57c-4d25-4691-97dd-cb1c062f5eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f55cd6b-70d8-41c1-a925-2b9f03e34802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f55cd6b-70d8-41c1-a925-2b9f03e34802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed57b6cc-b645-4e0e-a558-a5ea8424ab4e', 'volume_name': 'volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (786b7e97-f475-4e81-b277-4674a231e496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (786b7e97-f475-4e81-b277-4674a231e496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:56 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc89a6e-eab8-45e6-8965-fcaf2fcb091b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:56 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] Volume ed57b6cc-b645-4e0e-a558-a5ea8424ab4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e', 'volume_size': 1}
Nov 05 10:02:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:57 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b5d4522b-b099-477a-95c2-36e02a764216 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d.7a762787-0d39-49c2-a424-b1b0c7746814 1G" returned: 0 in 0.446s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b5d4522b-b099-477a-95c2-36e02a764216 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d.7a762787-0d39-49c2-a424-b1b0c7746814 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:57 devstack sudo[105030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d.7a762787-0d39-49c2-a424-b1b0c7746814
Nov 05 10:02:57 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:57 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b5d4522b-b099-477a-95c2-36e02a764216 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d.7a762787-0d39-49c2-a424-b1b0c7746814" returned: 0 in 0.296s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:57 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-b5d4522b-b099-477a-95c2-36e02a764216 tempest-ProjectReaderTests-1925760580 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d.7a762787-0d39-49c2-a424-b1b0c7746814 is being set with open permissions: ugo+rw
Nov 05 10:02:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b5d4522b-b099-477a-95c2-36e02a764216 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d.7a762787-0d39-49c2-a424-b1b0c7746814 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:57 devstack sudo[105035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d.7a762787-0d39-49c2-a424-b1b0c7746814
Nov 05 10:02:57 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:57 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b5d4522b-b099-477a-95c2-36e02a764216 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d.7a762787-0d39-49c2-a424-b1b0c7746814" returned: 0 in 0.246s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b5d4522b-b099-477a-95c2-36e02a764216 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:57 devstack sudo[105038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d.info
Nov 05 10:02:57 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:58 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b5d4522b-b099-477a-95c2-36e02a764216 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d.info" returned: 0 in 0.276s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:58 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-b5d4522b-b099-477a-95c2-36e02a764216 tempest-ProjectReaderTests-1925760580 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d.info is being set with open permissions: ugo+rw
Nov 05 10:02:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b5d4522b-b099-477a-95c2-36e02a764216 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:58 devstack sudo[105041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d.info
Nov 05 10:02:58 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:58 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-b5d4522b-b099-477a-95c2-36e02a764216 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d.info" returned: 0 in 0.265s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-b5d4522b-b099-477a-95c2-36e02a764216 tempest-ProjectReaderTests-1925760580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.059s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.423s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-4975919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed57b6cc-b645-4e0e-a558-a5ea8424ab4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e528f8801a4697bc8112c19f08f0c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:02:57Z,use_quota=True,user_id='db806d37a63442189c00f5196322142a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:02:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] Creating volume ed57b6cc-b645-4e0e-a558-a5ea8424ab4e {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:02:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:02:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:02:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:02:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:02:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:02:58 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:02:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:58 devstack sudo[105044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e 1073741824
Nov 05 10:02:58 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:58 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-b5d4522b-b099-477a-95c2-36e02a764216 tempest-ProjectReaderTests-1925760580 None] Create snapshot completed successfully
Nov 05 10:02:58 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e 1073741824" returned: 0 in 0.426s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:58 devstack sudo[105050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e
Nov 05 10:02:58 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:59 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e" returned: 0 in 0.243s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:02:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:02:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc89a6e-eab8-45e6-8965-fcaf2fcb091b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3fd5276-e547-4a4f-9798-3e07819143c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:02:59 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] Volume volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e (ed57b6cc-b645-4e0e-a558-a5ea8424ab4e): created successfully
Nov 05 10:02:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3fd5276-e547-4a4f-9798-3e07819143c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:02:59 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] Flow 'volume_create_manager' (b12b433e-7f0a-4826-8255-68cba2920cb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:02:59 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-73a6a62a-9173-4fb9-ade4-385c98a72333 tempest-ProjectMemberTests-1394267937 None] Created volume successfully.
Nov 05 10:02:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6291ddff-af61-40f0-89f5-53b0b56e3919 tempest-ProjectReaderTests-1925760580 None] Acquiring lock "cinder-7a762787-0d39-49c2-a424-b1b0c7746814-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6291ddff-af61-40f0-89f5-53b0b56e3919 tempest-ProjectReaderTests-1925760580 None] Lock "cinder-7a762787-0d39-49c2-a424-b1b0c7746814-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6291ddff-af61-40f0-89f5-53b0b56e3919 tempest-ProjectReaderTests-1925760580 None] Acquiring lock "cinder-quobyte-f0ff486b-d6bd-412e-a4a1-249d24caa18d" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6291ddff-af61-40f0-89f5-53b0b56e3919 tempest-ProjectReaderTests-1925760580 None] Lock "cinder-quobyte-f0ff486b-d6bd-412e-a4a1-249d24caa18d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6291ddff-af61-40f0-89f5-53b0b56e3919 tempest-ProjectReaderTests-1925760580 None] Acquiring lock "cinder-quobyte-7a762787-0d39-49c2-a424-b1b0c7746814" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:02:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6291ddff-af61-40f0-89f5-53b0b56e3919 tempest-ProjectReaderTests-1925760580 None] Lock "cinder-quobyte-7a762787-0d39-49c2-a424-b1b0c7746814" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:02:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-6291ddff-af61-40f0-89f5-53b0b56e3919 tempest-ProjectReaderTests-1925760580 None] Deleting offline snapshot 7a762787-0d39-49c2-a424-b1b0c7746814 of volume f0ff486b-d6bd-412e-a4a1-249d24caa18d {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 10:02:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-6291ddff-af61-40f0-89f5-53b0b56e3919 tempest-ProjectReaderTests-1925760580 None] snapshot_file for this snap is: volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d.7a762787-0d39-49c2-a424-b1b0c7746814 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 10:02:59 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[2803caa3-abdb-40c7-9e8c-a508480c4e29]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6291ddff-af61-40f0-89f5-53b0b56e3919 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d.7a762787-0d39-49c2-a424-b1b0c7746814 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:59 devstack sudo[105053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d.7a762787-0d39-49c2-a424-b1b0c7746814
Nov 05 10:02:59 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:02:59 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root
Nov 05 10:02:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6291ddff-af61-40f0-89f5-53b0b56e3919 tempest-ProjectReaderTests-1925760580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d.7a762787-0d39-49c2-a424-b1b0c7746814" returned: 0 in 0.361s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:02:59 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-6291ddff-af61-40f0-89f5-53b0b56e3919 tempest-ProjectReaderTests-1925760580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 10:02:59 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[5771ca2b-fac0-4bc5-a201-1d5ddb576713]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:02:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6291ddff-af61-40f0-89f5-53b0b56e3919 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:02:59 devstack sudo[105059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d
Nov 05 10:02:59 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 10:03:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:03:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:03:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:03:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:03:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:03:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:00 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:00 devstack sudo[105064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:03:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6291ddff-af61-40f0-89f5-53b0b56e3919 tempest-ProjectReaderTests-1925760580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d" returned: 0 in 0.395s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6291ddff-af61-40f0-89f5-53b0b56e3919 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d.7a762787-0d39-49c2-a424-b1b0c7746814 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:00 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:00 devstack sudo[105066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d.7a762787-0d39-49c2-a424-b1b0c7746814
Nov 05 10:03:00 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f0977321-3ccb-4c57-8c4c-12d1b9f3683f tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:03:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f0977321-3ccb-4c57-8c4c-12d1b9f3683f tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:03:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-f0977321-3ccb-4c57-8c4c-12d1b9f3683f tempest-ProjectMemberTests-1394267937 None] Creating offline snapshot 8307eeb8-2915-438b-af23-e9a80e132dc7 of volume ed57b6cc-b645-4e0e-a558-a5ea8424ab4e {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 10:03:00 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[2756dac9-ac10-4690-a44b-02254dec93c3]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:03:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0977321-3ccb-4c57-8c4c-12d1b9f3683f tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:00 devstack sudo[105068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e
Nov 05 10:03:00 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:00 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.288s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:03:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 10:03:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 28 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 10:03:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>, <Thread(tpool_thread_0, started daemon 132223357408960)>, <Thread(tpool_thread_1, started daemon 132223349016256)>, <Thread(tpool_thread_2, started daemon 132223340623552)>, <Thread(tpool_thread_3, started daemon 132223332230848)>, <Thread(tpool_thread_4, started daemon 132223323838144)>, <Thread(tpool_thread_5, started daemon 132223315445440)>, <Thread(tpool_thread_6, started daemon 132223307052736)>, <Thread(tpool_thread_7, started daemon 132223298660032)>, <Thread(tpool_thread_8, started daemon 132223290250944)>, <Thread(tpool_thread_9, started daemon 132223281841856)>, <Thread(tpool_thread_10, started daemon 132223273432768)>, <Thread(tpool_thread_11, started daemon 132223265023680)>, <Thread(tpool_thread_12, started daemon 132223256614592)>, <Thread(tpool_thread_13, started daemon 132223248205504)>, <Thread(tpool_thread_14, started daemon 132223239796416)>, <Thread(tpool_thread_15, started daemon 132223231387328)>, <Thread(tpool_thread_16, started daemon 132223222978240)>, <Thread(tpool_thread_17, started daemon 132223214569152)>, <Thread(tpool_thread_18, started daemon 132223206160064)>, <Thread(tpool_thread_19, started daemon 132223197750976)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 10:03:00 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6291ddff-af61-40f0-89f5-53b0b56e3919 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d.7a762787-0d39-49c2-a424-b1b0c7746814" returned: 0 in 0.379s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6291ddff-af61-40f0-89f5-53b0b56e3919 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d.7a762787-0d39-49c2-a424-b1b0c7746814 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:00 devstack sudo[105074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d.7a762787-0d39-49c2-a424-b1b0c7746814
Nov 05 10:03:00 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:00 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0977321-3ccb-4c57-8c4c-12d1b9f3683f tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e" returned: 0 in 0.396s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0977321-3ccb-4c57-8c4c-12d1b9f3683f tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e.8307eeb8-2915-438b-af23-e9a80e132dc7 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:00 devstack sudo[105079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e.8307eeb8-2915-438b-af23-e9a80e132dc7 1G
Nov 05 10:03:00 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:00 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6291ddff-af61-40f0-89f5-53b0b56e3919 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d.7a762787-0d39-49c2-a424-b1b0c7746814" returned: 0 in 0.267s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:00 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6291ddff-af61-40f0-89f5-53b0b56e3919 tempest-ProjectReaderTests-1925760580 None] Lock "cinder-quobyte-7a762787-0d39-49c2-a424-b1b0c7746814" released by "_delete_snapshot" :: held 1.501s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:00 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6291ddff-af61-40f0-89f5-53b0b56e3919 tempest-ProjectReaderTests-1925760580 None] Lock "cinder-quobyte-f0ff486b-d6bd-412e-a4a1-249d24caa18d" released by "delete_snapshot" :: held 1.522s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:01 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-6291ddff-af61-40f0-89f5-53b0b56e3919 tempest-ProjectReaderTests-1925760580 None] Created reservations ['cc67261b-f4bf-416b-9773-19511349424a', '4ffbd44b-f642-45a2-981f-5b7083a05fee', 'f71ce236-4e93-406d-8cb7-a3fb4f78c05d', '409a61f6-93d5-4f2b-aa76-520c66c5b051'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:03:01 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-6291ddff-af61-40f0-89f5-53b0b56e3919 tempest-ProjectReaderTests-1925760580 None] Delete snapshot completed successfully.
Nov 05 10:03:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6291ddff-af61-40f0-89f5-53b0b56e3919 tempest-ProjectReaderTests-1925760580 None] Lock "cinder-7a762787-0d39-49c2-a424-b1b0c7746814-delete_snapshot" released by "delete_snapshot" :: held 1.664s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:01 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0977321-3ccb-4c57-8c4c-12d1b9f3683f tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e.8307eeb8-2915-438b-af23-e9a80e132dc7 1G" returned: 0 in 0.444s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0977321-3ccb-4c57-8c4c-12d1b9f3683f tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e.8307eeb8-2915-438b-af23-e9a80e132dc7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:01 devstack sudo[105086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e.8307eeb8-2915-438b-af23-e9a80e132dc7
Nov 05 10:03:01 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:01 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0977321-3ccb-4c57-8c4c-12d1b9f3683f tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e.8307eeb8-2915-438b-af23-e9a80e132dc7" returned: 0 in 0.301s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:01 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-f0977321-3ccb-4c57-8c4c-12d1b9f3683f tempest-ProjectMemberTests-1394267937 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e.8307eeb8-2915-438b-af23-e9a80e132dc7 is being set with open permissions: ugo+rw
Nov 05 10:03:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0977321-3ccb-4c57-8c4c-12d1b9f3683f tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e.8307eeb8-2915-438b-af23-e9a80e132dc7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:01 devstack sudo[105091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e.8307eeb8-2915-438b-af23-e9a80e132dc7
Nov 05 10:03:01 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ece9edac-2e49-4410-9eb4-8d62841262c6 tempest-ProjectReaderTests-1925760580 None] Acquiring lock "cinder-f0ff486b-d6bd-412e-a4a1-249d24caa18d-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ece9edac-2e49-4410-9eb4-8d62841262c6 tempest-ProjectReaderTests-1925760580 None] Lock "cinder-f0ff486b-d6bd-412e-a4a1-249d24caa18d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ece9edac-2e49-4410-9eb4-8d62841262c6 tempest-ProjectReaderTests-1925760580 None] Acquiring lock "cinder-quobyte-f0ff486b-d6bd-412e-a4a1-249d24caa18d" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:01 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ece9edac-2e49-4410-9eb4-8d62841262c6 tempest-ProjectReaderTests-1925760580 None] Lock "cinder-quobyte-f0ff486b-d6bd-412e-a4a1-249d24caa18d" acquired by "delete_volume" :: waited 0.019s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:01 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d701473e-c15e-4fdd-b111-c620d89b611b]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:03:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ece9edac-2e49-4410-9eb4-8d62841262c6 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:01 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0977321-3ccb-4c57-8c4c-12d1b9f3683f tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e.8307eeb8-2915-438b-af23-e9a80e132dc7" returned: 0 in 0.277s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:01 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0977321-3ccb-4c57-8c4c-12d1b9f3683f tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:01 devstack sudo[105093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d
Nov 05 10:03:01 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:01 devstack sudo[105095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e.info
Nov 05 10:03:01 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:02 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:02 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ece9edac-2e49-4410-9eb4-8d62841262c6 tempest-ProjectReaderTests-1925760580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d" returned: 0 in 0.385s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ece9edac-2e49-4410-9eb4-8d62841262c6 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0977321-3ccb-4c57-8c4c-12d1b9f3683f tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e.info" returned: 0 in 0.292s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:02 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-f0977321-3ccb-4c57-8c4c-12d1b9f3683f tempest-ProjectMemberTests-1394267937 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e.info is being set with open permissions: ugo+rw
Nov 05 10:03:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0977321-3ccb-4c57-8c4c-12d1b9f3683f tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:02 devstack sudo[105102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d
Nov 05 10:03:02 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:02 devstack sudo[105103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e.info
Nov 05 10:03:02 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:02 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ece9edac-2e49-4410-9eb4-8d62841262c6 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-f0ff486b-d6bd-412e-a4a1-249d24caa18d" returned: 0 in 0.254s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:02 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-f0977321-3ccb-4c57-8c4c-12d1b9f3683f tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e.info" returned: 0 in 0.257s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-f0977321-3ccb-4c57-8c4c-12d1b9f3683f tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.066s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:03:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ece9edac-2e49-4410-9eb4-8d62841262c6 tempest-ProjectReaderTests-1925760580 None] Lock "cinder-quobyte-f0ff486b-d6bd-412e-a4a1-249d24caa18d" released by "delete_volume" :: held 0.737s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:02 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-f0977321-3ccb-4c57-8c4c-12d1b9f3683f tempest-ProjectMemberTests-1394267937 None] Create snapshot completed successfully
Nov 05 10:03:02 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-ece9edac-2e49-4410-9eb4-8d62841262c6 tempest-ProjectReaderTests-1925760580 None] Created reservations ['929bb70e-a6cf-4053-aad6-a702284daa4f', 'b3edcc93-8677-4b25-8b7c-4c9579e47453', 'efc19a39-9c7a-46e7-b572-7d7fbfd80f71', '6146b4a1-ac2f-4420-9bf9-a4466c37e4ac'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:03:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ece9edac-2e49-4410-9eb4-8d62841262c6 tempest-ProjectReaderTests-1925760580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:03:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ece9edac-2e49-4410-9eb4-8d62841262c6 tempest-ProjectReaderTests-1925760580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:03:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ece9edac-2e49-4410-9eb4-8d62841262c6 tempest-ProjectReaderTests-1925760580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:03:02 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-ece9edac-2e49-4410-9eb4-8d62841262c6 tempest-ProjectReaderTests-1925760580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:03:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-ece9edac-2e49-4410-9eb4-8d62841262c6 tempest-ProjectReaderTests-1925760580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:03:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ece9edac-2e49-4410-9eb4-8d62841262c6 tempest-ProjectReaderTests-1925760580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:02 devstack sudo[105108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:03:02 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:02 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:02 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-ece9edac-2e49-4410-9eb4-8d62841262c6 tempest-ProjectReaderTests-1925760580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.265s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:02 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-ece9edac-2e49-4410-9eb4-8d62841262c6 tempest-ProjectReaderTests-1925760580 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:03:02 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-ece9edac-2e49-4410-9eb4-8d62841262c6 tempest-ProjectReaderTests-1925760580 None] Deleted volume successfully.
Nov 05 10:03:02 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-ece9edac-2e49-4410-9eb4-8d62841262c6 tempest-ProjectReaderTests-1925760580 None] Lock "cinder-f0ff486b-d6bd-412e-a4a1-249d24caa18d-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-43235a7c-1069-4ba6-b1ce-fda5b5ac1810 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-8307eeb8-2915-438b-af23-e9a80e132dc7-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-43235a7c-1069-4ba6-b1ce-fda5b5ac1810 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-8307eeb8-2915-438b-af23-e9a80e132dc7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-43235a7c-1069-4ba6-b1ce-fda5b5ac1810 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-quobyte-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-43235a7c-1069-4ba6-b1ce-fda5b5ac1810 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-43235a7c-1069-4ba6-b1ce-fda5b5ac1810 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-quobyte-8307eeb8-2915-438b-af23-e9a80e132dc7" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:03 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-43235a7c-1069-4ba6-b1ce-fda5b5ac1810 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-8307eeb8-2915-438b-af23-e9a80e132dc7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-43235a7c-1069-4ba6-b1ce-fda5b5ac1810 tempest-ProjectMemberTests-1394267937 None] Deleting offline snapshot 8307eeb8-2915-438b-af23-e9a80e132dc7 of volume ed57b6cc-b645-4e0e-a558-a5ea8424ab4e {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 10:03:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-43235a7c-1069-4ba6-b1ce-fda5b5ac1810 tempest-ProjectMemberTests-1394267937 None] snapshot_file for this snap is: volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e.8307eeb8-2915-438b-af23-e9a80e132dc7 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 10:03:03 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae2f9c5-d53f-4fdd-b704-51578a93a0e9]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:03:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-43235a7c-1069-4ba6-b1ce-fda5b5ac1810 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e.8307eeb8-2915-438b-af23-e9a80e132dc7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:03 devstack sudo[105111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e.8307eeb8-2915-438b-af23-e9a80e132dc7
Nov 05 10:03:03 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:03 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:03 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-43235a7c-1069-4ba6-b1ce-fda5b5ac1810 tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e.8307eeb8-2915-438b-af23-e9a80e132dc7" returned: 0 in 0.397s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:03 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-43235a7c-1069-4ba6-b1ce-fda5b5ac1810 tempest-ProjectMemberTests-1394267937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 10:03:04 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a4b9ae-503c-4d66-82a5-9d4f3ad52e3d]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:03:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-43235a7c-1069-4ba6-b1ce-fda5b5ac1810 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:04 devstack sudo[105117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e
Nov 05 10:03:04 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:04 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-43235a7c-1069-4ba6-b1ce-fda5b5ac1810 tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e" returned: 0 in 0.410s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-43235a7c-1069-4ba6-b1ce-fda5b5ac1810 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e.8307eeb8-2915-438b-af23-e9a80e132dc7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:04 devstack sudo[105122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e.8307eeb8-2915-438b-af23-e9a80e132dc7
Nov 05 10:03:04 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:04 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-43235a7c-1069-4ba6-b1ce-fda5b5ac1810 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e.8307eeb8-2915-438b-af23-e9a80e132dc7" returned: 0 in 0.386s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:04 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-43235a7c-1069-4ba6-b1ce-fda5b5ac1810 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e.8307eeb8-2915-438b-af23-e9a80e132dc7 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:04 devstack sudo[105128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e.8307eeb8-2915-438b-af23-e9a80e132dc7
Nov 05 10:03:04 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:05 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-43235a7c-1069-4ba6-b1ce-fda5b5ac1810 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e.8307eeb8-2915-438b-af23-e9a80e132dc7" returned: 0 in 0.262s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-43235a7c-1069-4ba6-b1ce-fda5b5ac1810 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-8307eeb8-2915-438b-af23-e9a80e132dc7" released by "_delete_snapshot" :: held 1.586s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-43235a7c-1069-4ba6-b1ce-fda5b5ac1810 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e" released by "delete_snapshot" :: held 1.612s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:05 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-43235a7c-1069-4ba6-b1ce-fda5b5ac1810 tempest-ProjectMemberTests-1394267937 None] Created reservations ['98702771-e91f-4194-83b6-05bb0d0c45bd', '62da0af5-3531-43c8-9d81-49370903ea11', '7d7c0060-4682-4cc3-9c45-dd1137e3ef5c', '3e10b7e8-72a5-4fd3-bcf8-a4c68b7a34da'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:03:05 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-43235a7c-1069-4ba6-b1ce-fda5b5ac1810 tempest-ProjectMemberTests-1394267937 None] Delete snapshot completed successfully.
Nov 05 10:03:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-43235a7c-1069-4ba6-b1ce-fda5b5ac1810 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-8307eeb8-2915-438b-af23-e9a80e132dc7-delete_snapshot" released by "delete_snapshot" :: held 1.778s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-eb6a37d3-830f-4247-ad16-448ab2e64bfc tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-eb6a37d3-830f-4247-ad16-448ab2e64bfc tempest-ProjectMemberTests-1394267937 None] Lock "cinder-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-eb6a37d3-830f-4247-ad16-448ab2e64bfc tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-quobyte-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:05 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-eb6a37d3-830f-4247-ad16-448ab2e64bfc tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:05 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3834130-f1ff-4e14-99a5-85d826c24f69]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:03:05 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eb6a37d3-830f-4247-ad16-448ab2e64bfc tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:05 devstack sudo[105131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e
Nov 05 10:03:05 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:06 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eb6a37d3-830f-4247-ad16-448ab2e64bfc tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e" returned: 0 in 0.385s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eb6a37d3-830f-4247-ad16-448ab2e64bfc tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:06 devstack sudo[105137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e
Nov 05 10:03:06 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:06 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eb6a37d3-830f-4247-ad16-448ab2e64bfc tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e" returned: 0 in 0.271s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-eb6a37d3-830f-4247-ad16-448ab2e64bfc tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e" released by "delete_volume" :: held 0.725s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:06 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-eb6a37d3-830f-4247-ad16-448ab2e64bfc tempest-ProjectMemberTests-1394267937 None] Created reservations ['c08e7db6-dd6e-4364-b01f-5342082b1920', '7f5ac54b-2c31-4510-b4a4-338c89e4af35', '50526845-d038-4e99-baef-e4e19cdcfb15', '24187505-dfc7-44fb-96b6-538e7803a77d'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:03:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-eb6a37d3-830f-4247-ad16-448ab2e64bfc tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:03:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-eb6a37d3-830f-4247-ad16-448ab2e64bfc tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:03:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-eb6a37d3-830f-4247-ad16-448ab2e64bfc tempest-ProjectMemberTests-1394267937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:03:06 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-eb6a37d3-830f-4247-ad16-448ab2e64bfc tempest-ProjectMemberTests-1394267937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:03:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-eb6a37d3-830f-4247-ad16-448ab2e64bfc tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:03:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eb6a37d3-830f-4247-ad16-448ab2e64bfc tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:06 devstack sudo[105140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:03:06 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:06 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:06 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-eb6a37d3-830f-4247-ad16-448ab2e64bfc tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.286s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:06 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-eb6a37d3-830f-4247-ad16-448ab2e64bfc tempest-ProjectMemberTests-1394267937 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:03:06 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-eb6a37d3-830f-4247-ad16-448ab2e64bfc tempest-ProjectMemberTests-1394267937 None] Deleted volume successfully.
Nov 05 10:03:06 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-eb6a37d3-830f-4247-ad16-448ab2e64bfc tempest-ProjectMemberTests-1394267937 None] Lock "cinder-ed57b6cc-b645-4e0e-a558-a5ea8424ab4e-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:07 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:03:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] Flow 'volume_create_manager' (0564b3a6-64e8-48ed-9276-f364023ec683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:03:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f72e76-1f82-4fd5-ada7-6ae999c96965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f72e76-1f82-4fd5-ada7-6ae999c96965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2117483170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd554f68-e879-41c4-b3f4-5eff7d16979c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e528f8801a4697bc8112c19f08f0c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:03:07Z,use_quota=True,user_id='db806d37a63442189c00f5196322142a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3612186-5580-4caf-8afc-ea3538f21887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3612186-5580-4caf-8afc-ea3538f21887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7534907b-6bfb-4882-a2ca-a62b3b6a0945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7534907b-6bfb-4882-a2ca-a62b3b6a0945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd554f68-e879-41c4-b3f4-5eff7d16979c', 'volume_name': 'volume-cd554f68-e879-41c4-b3f4-5eff7d16979c', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee373d18-1bb3-47b7-b943-60648cf3d233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee373d18-1bb3-47b7-b943-60648cf3d233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:07 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (104c2d85-6c3e-4679-89a5-531f2ab06678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:07 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] Volume cd554f68-e879-41c4-b3f4-5eff7d16979c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd554f68-e879-41c4-b3f4-5eff7d16979c', 'volume_size': 1}
Nov 05 10:03:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:03:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:03:07 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2117483170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd554f68-e879-41c4-b3f4-5eff7d16979c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e528f8801a4697bc8112c19f08f0c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:03:07Z,use_quota=True,user_id='db806d37a63442189c00f5196322142a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:03:07 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] Creating volume cd554f68-e879-41c4-b3f4-5eff7d16979c {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:03:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:03:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:03:07 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:03:07 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:03:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:03:07 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:03:07 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:03:07 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:07 devstack sudo[105143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c 1073741824
Nov 05 10:03:07 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:07 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c 1073741824" returned: 0 in 0.494s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:08 devstack sudo[105149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c
Nov 05 10:03:08 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:08 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c" returned: 0 in 0.255s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:08 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:03:08 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:03:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (104c2d85-6c3e-4679-89a5-531f2ab06678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd554f68-e879-41c4-b3f4-5eff7d16979c', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b8e92e-80ad-4855-b83c-c25b21dbd00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:08 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] Volume volume-cd554f68-e879-41c4-b3f4-5eff7d16979c (cd554f68-e879-41c4-b3f4-5eff7d16979c): created successfully
Nov 05 10:03:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b8e92e-80ad-4855-b83c-c25b21dbd00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:08 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] Flow 'volume_create_manager' (0564b3a6-64e8-48ed-9276-f364023ec683) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:03:08 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-6cd036a3-534e-476e-8c62-aeb3bfbd7760 tempest-ProjectMemberTests-1394267937 None] Created volume successfully.
Nov 05 10:03:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d6050695-2b5e-4b11-8118-2b24a441698d tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:03:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d6050695-2b5e-4b11-8118-2b24a441698d tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:03:09 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-d6050695-2b5e-4b11-8118-2b24a441698d tempest-ProjectMemberTests-1394267937 None] Creating offline snapshot 32332485-66c8-4bdf-9dca-a5f8e34d21a2 of volume cd554f68-e879-41c4-b3f4-5eff7d16979c {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 10:03:09 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[131c8d59-61d5-4843-89be-66d53ec74b06]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:03:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d6050695-2b5e-4b11-8118-2b24a441698d tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:09 devstack sudo[105152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c
Nov 05 10:03:09 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:10 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d6050695-2b5e-4b11-8118-2b24a441698d tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c" returned: 0 in 0.404s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d6050695-2b5e-4b11-8118-2b24a441698d tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c.32332485-66c8-4bdf-9dca-a5f8e34d21a2 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:10 devstack sudo[105158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c.32332485-66c8-4bdf-9dca-a5f8e34d21a2 1G
Nov 05 10:03:10 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:10 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d6050695-2b5e-4b11-8118-2b24a441698d tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c.32332485-66c8-4bdf-9dca-a5f8e34d21a2 1G" returned: 0 in 0.439s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d6050695-2b5e-4b11-8118-2b24a441698d tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd554f68-e879-41c4-b3f4-5eff7d16979c -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c.32332485-66c8-4bdf-9dca-a5f8e34d21a2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:10 devstack sudo[105164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd554f68-e879-41c4-b3f4-5eff7d16979c -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c.32332485-66c8-4bdf-9dca-a5f8e34d21a2
Nov 05 10:03:10 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:10 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d6050695-2b5e-4b11-8118-2b24a441698d tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd554f68-e879-41c4-b3f4-5eff7d16979c -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c.32332485-66c8-4bdf-9dca-a5f8e34d21a2" returned: 0 in 0.326s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:10 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-d6050695-2b5e-4b11-8118-2b24a441698d tempest-ProjectMemberTests-1394267937 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c.32332485-66c8-4bdf-9dca-a5f8e34d21a2 is being set with open permissions: ugo+rw
Nov 05 10:03:10 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d6050695-2b5e-4b11-8118-2b24a441698d tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c.32332485-66c8-4bdf-9dca-a5f8e34d21a2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:10 devstack sudo[105169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c.32332485-66c8-4bdf-9dca-a5f8e34d21a2
Nov 05 10:03:10 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:11 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d6050695-2b5e-4b11-8118-2b24a441698d tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c.32332485-66c8-4bdf-9dca-a5f8e34d21a2" returned: 0 in 0.269s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d6050695-2b5e-4b11-8118-2b24a441698d tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:11 devstack sudo[105172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c.info
Nov 05 10:03:11 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:11 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d6050695-2b5e-4b11-8118-2b24a441698d tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c.info" returned: 0 in 0.280s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:11 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-d6050695-2b5e-4b11-8118-2b24a441698d tempest-ProjectMemberTests-1394267937 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c.info is being set with open permissions: ugo+rw
Nov 05 10:03:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d6050695-2b5e-4b11-8118-2b24a441698d tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:11 devstack sudo[105175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c.info
Nov 05 10:03:11 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:11 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d6050695-2b5e-4b11-8118-2b24a441698d tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c.info" returned: 0 in 0.293s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:11 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d6050695-2b5e-4b11-8118-2b24a441698d tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.135s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:03:11 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-d6050695-2b5e-4b11-8118-2b24a441698d tempest-ProjectMemberTests-1394267937 None] Create snapshot completed successfully
Nov 05 10:03:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1d293a71-6d34-4aef-87bd-85192dfbf547 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-32332485-66c8-4bdf-9dca-a5f8e34d21a2-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1d293a71-6d34-4aef-87bd-85192dfbf547 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-32332485-66c8-4bdf-9dca-a5f8e34d21a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1d293a71-6d34-4aef-87bd-85192dfbf547 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-quobyte-cd554f68-e879-41c4-b3f4-5eff7d16979c" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1d293a71-6d34-4aef-87bd-85192dfbf547 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-cd554f68-e879-41c4-b3f4-5eff7d16979c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1d293a71-6d34-4aef-87bd-85192dfbf547 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-quobyte-32332485-66c8-4bdf-9dca-a5f8e34d21a2" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:12 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1d293a71-6d34-4aef-87bd-85192dfbf547 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-32332485-66c8-4bdf-9dca-a5f8e34d21a2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-1d293a71-6d34-4aef-87bd-85192dfbf547 tempest-ProjectMemberTests-1394267937 None] Deleting offline snapshot 32332485-66c8-4bdf-9dca-a5f8e34d21a2 of volume cd554f68-e879-41c4-b3f4-5eff7d16979c {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 10:03:12 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-1d293a71-6d34-4aef-87bd-85192dfbf547 tempest-ProjectMemberTests-1394267937 None] snapshot_file for this snap is: volume-cd554f68-e879-41c4-b3f4-5eff7d16979c.32332485-66c8-4bdf-9dca-a5f8e34d21a2 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 10:03:12 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[98920406-7c4d-4a51-bd23-4480b3c840c6]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:03:12 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d293a71-6d34-4aef-87bd-85192dfbf547 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c.32332485-66c8-4bdf-9dca-a5f8e34d21a2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:13 devstack sudo[105178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c.32332485-66c8-4bdf-9dca-a5f8e34d21a2
Nov 05 10:03:13 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:13 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d293a71-6d34-4aef-87bd-85192dfbf547 tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c.32332485-66c8-4bdf-9dca-a5f8e34d21a2" returned: 0 in 0.397s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:13 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-1d293a71-6d34-4aef-87bd-85192dfbf547 tempest-ProjectMemberTests-1394267937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd554f68-e879-41c4-b3f4-5eff7d16979c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 10:03:13 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[252ae6e6-3ee5-420b-a0a8-2e75ae252300]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:03:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d293a71-6d34-4aef-87bd-85192dfbf547 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:13 devstack sudo[105183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c
Nov 05 10:03:13 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:13 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d293a71-6d34-4aef-87bd-85192dfbf547 tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c" returned: 0 in 0.413s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:13 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d293a71-6d34-4aef-87bd-85192dfbf547 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c.32332485-66c8-4bdf-9dca-a5f8e34d21a2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:13 devstack sudo[105188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c.32332485-66c8-4bdf-9dca-a5f8e34d21a2
Nov 05 10:03:13 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:14 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d293a71-6d34-4aef-87bd-85192dfbf547 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c.32332485-66c8-4bdf-9dca-a5f8e34d21a2" returned: 0 in 0.372s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d293a71-6d34-4aef-87bd-85192dfbf547 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c.32332485-66c8-4bdf-9dca-a5f8e34d21a2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:14 devstack sudo[105193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c.32332485-66c8-4bdf-9dca-a5f8e34d21a2
Nov 05 10:03:14 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:14 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:14 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-1d293a71-6d34-4aef-87bd-85192dfbf547 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c.32332485-66c8-4bdf-9dca-a5f8e34d21a2" returned: 0 in 0.266s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:14 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1d293a71-6d34-4aef-87bd-85192dfbf547 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-32332485-66c8-4bdf-9dca-a5f8e34d21a2" released by "_delete_snapshot" :: held 1.568s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:14 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1d293a71-6d34-4aef-87bd-85192dfbf547 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-cd554f68-e879-41c4-b3f4-5eff7d16979c" released by "delete_snapshot" :: held 1.593s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:14 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-1d293a71-6d34-4aef-87bd-85192dfbf547 tempest-ProjectMemberTests-1394267937 None] Created reservations ['479fd9d0-e81c-48aa-ae1a-c17953b15ac6', 'ed5b2764-02b4-4e07-bc4d-c779c010cc11', 'bf7b36da-1c09-4bc2-a4d9-3431beb1b1d8', '4694345b-8dba-4a26-b2a1-8fdcbba3aedb'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:03:14 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-1d293a71-6d34-4aef-87bd-85192dfbf547 tempest-ProjectMemberTests-1394267937 None] Delete snapshot completed successfully.
Nov 05 10:03:14 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-1d293a71-6d34-4aef-87bd-85192dfbf547 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-32332485-66c8-4bdf-9dca-a5f8e34d21a2-delete_snapshot" released by "delete_snapshot" :: held 1.764s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2c92937f-d9c0-4590-ba82-b45fc6a48c82 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-cd554f68-e879-41c4-b3f4-5eff7d16979c-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2c92937f-d9c0-4590-ba82-b45fc6a48c82 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-cd554f68-e879-41c4-b3f4-5eff7d16979c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2c92937f-d9c0-4590-ba82-b45fc6a48c82 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-quobyte-cd554f68-e879-41c4-b3f4-5eff7d16979c" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2c92937f-d9c0-4590-ba82-b45fc6a48c82 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-cd554f68-e879-41c4-b3f4-5eff7d16979c" acquired by "delete_volume" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:15 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b715143-b970-455b-9659-51ca98cb1960]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:03:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2c92937f-d9c0-4590-ba82-b45fc6a48c82 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:15 devstack sudo[105196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c
Nov 05 10:03:15 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:15 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2c92937f-d9c0-4590-ba82-b45fc6a48c82 tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c" returned: 0 in 0.422s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2c92937f-d9c0-4590-ba82-b45fc6a48c82 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:15 devstack sudo[105201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c
Nov 05 10:03:15 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:15 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:15 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2c92937f-d9c0-4590-ba82-b45fc6a48c82 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cd554f68-e879-41c4-b3f4-5eff7d16979c" returned: 0 in 0.267s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:15 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2c92937f-d9c0-4590-ba82-b45fc6a48c82 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-cd554f68-e879-41c4-b3f4-5eff7d16979c" released by "delete_volume" :: held 0.761s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:15 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-2c92937f-d9c0-4590-ba82-b45fc6a48c82 tempest-ProjectMemberTests-1394267937 None] Created reservations ['ff709fef-abfe-44af-b4c7-fe80a82c268c', '1812cec7-1661-4926-88cd-490a68b99e7d', '19f78752-bf04-421b-b71d-4152ae415913', 'f09c750f-43b9-478a-a3af-fb0f1c0d4e22'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:03:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2c92937f-d9c0-4590-ba82-b45fc6a48c82 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:03:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2c92937f-d9c0-4590-ba82-b45fc6a48c82 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:03:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2c92937f-d9c0-4590-ba82-b45fc6a48c82 tempest-ProjectMemberTests-1394267937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:03:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-2c92937f-d9c0-4590-ba82-b45fc6a48c82 tempest-ProjectMemberTests-1394267937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:03:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-2c92937f-d9c0-4590-ba82-b45fc6a48c82 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:03:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2c92937f-d9c0-4590-ba82-b45fc6a48c82 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:16 devstack sudo[105204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:03:16 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:16 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2c92937f-d9c0-4590-ba82-b45fc6a48c82 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.291s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:16 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-2c92937f-d9c0-4590-ba82-b45fc6a48c82 tempest-ProjectMemberTests-1394267937 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:03:16 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-2c92937f-d9c0-4590-ba82-b45fc6a48c82 tempest-ProjectMemberTests-1394267937 None] Deleted volume successfully.
Nov 05 10:03:16 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2c92937f-d9c0-4590-ba82-b45fc6a48c82 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-cd554f68-e879-41c4-b3f4-5eff7d16979c-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:16 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:03:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] Flow 'volume_create_manager' (9a434ff2-43be-420a-a4a1-58775b4ca636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:03:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f86b0e-b352-46cc-943a-cae28d613d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:16 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=198,cinder:UPDATE=265,cinder:INSERT=70,cinder:DELETE=25 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 10:03:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f86b0e-b352-46cc-943a-cae28d613d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-718167341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cae59ee4-5126-4098-b4a3-6fa657fb9bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e528f8801a4697bc8112c19f08f0c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:03:17Z,use_quota=True,user_id='db806d37a63442189c00f5196322142a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (200cebdc-e6f9-4162-a129-e6f839280b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (200cebdc-e6f9-4162-a129-e6f839280b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d7ff10-86ae-4370-b9ff-f64fb5fcc8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d7ff10-86ae-4370-b9ff-f64fb5fcc8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cae59ee4-5126-4098-b4a3-6fa657fb9bc2', 'volume_name': 'volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf6145da-c1c7-4535-b54a-96e789c7a55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf6145da-c1c7-4535-b54a-96e789c7a55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:16 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db692ec0-7fce-4b21-aa52-cc710d431c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:16 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] Volume cae59ee4-5126-4098-b4a3-6fa657fb9bc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2', 'volume_size': 1}
Nov 05 10:03:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:03:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:03:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-718167341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cae59ee4-5126-4098-b4a3-6fa657fb9bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e528f8801a4697bc8112c19f08f0c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:03:17Z,use_quota=True,user_id='db806d37a63442189c00f5196322142a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:03:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] Creating volume cae59ee4-5126-4098-b4a3-6fa657fb9bc2 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:03:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:03:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:03:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:03:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:03:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:03:16 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:03:16 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:03:16 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:16 devstack sudo[105207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2 1073741824
Nov 05 10:03:16 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:17 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2 1073741824" returned: 0 in 0.483s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:17 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:SELECT=212,cinder:INSERT=75,cinder:UPDATE=281,cinder:DELETE=19 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 10:03:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:17 devstack sudo[105213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2
Nov 05 10:03:17 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:17 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2" returned: 0 in 0.321s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:17 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:03:17 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:03:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db692ec0-7fce-4b21-aa52-cc710d431c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c80496-f493-4b86-b44d-7318b4a136d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:17 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] Volume volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2 (cae59ee4-5126-4098-b4a3-6fa657fb9bc2): created successfully
Nov 05 10:03:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c80496-f493-4b86-b44d-7318b4a136d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:17 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] Flow 'volume_create_manager' (9a434ff2-43be-420a-a4a1-58775b4ca636) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:03:17 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-e58e4551-2cc7-4ff9-8b0d-f93fc00b143e tempest-ProjectMemberTests-1394267937 None] Created volume successfully.
Nov 05 10:03:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-370f4c79-d2a5-4a1c-864c-34a2e8cf2ca8 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:03:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-370f4c79-d2a5-4a1c-864c-34a2e8cf2ca8 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:03:19 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-370f4c79-d2a5-4a1c-864c-34a2e8cf2ca8 tempest-ProjectMemberTests-1394267937 None] Creating offline snapshot d4fc55ac-62a1-406f-a39c-ec93bcf12b6d of volume cae59ee4-5126-4098-b4a3-6fa657fb9bc2 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 10:03:19 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f0c2e5-0384-4bda-8f50-5aa4c327775c]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:03:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-370f4c79-d2a5-4a1c-864c-34a2e8cf2ca8 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:19 devstack sudo[105216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2
Nov 05 10:03:19 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:19 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-370f4c79-d2a5-4a1c-864c-34a2e8cf2ca8 tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2" returned: 0 in 0.393s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-370f4c79-d2a5-4a1c-864c-34a2e8cf2ca8 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2.d4fc55ac-62a1-406f-a39c-ec93bcf12b6d 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:19 devstack sudo[105221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2.d4fc55ac-62a1-406f-a39c-ec93bcf12b6d 1G
Nov 05 10:03:19 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:19 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-370f4c79-d2a5-4a1c-864c-34a2e8cf2ca8 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2.d4fc55ac-62a1-406f-a39c-ec93bcf12b6d 1G" returned: 0 in 0.467s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:19 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-370f4c79-d2a5-4a1c-864c-34a2e8cf2ca8 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2.d4fc55ac-62a1-406f-a39c-ec93bcf12b6d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:20 devstack sudo[105228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2.d4fc55ac-62a1-406f-a39c-ec93bcf12b6d
Nov 05 10:03:20 devstack sudo[105228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:20 devstack sudo[105228]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-370f4c79-d2a5-4a1c-864c-34a2e8cf2ca8 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2.d4fc55ac-62a1-406f-a39c-ec93bcf12b6d" returned: 0 in 0.357s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:20 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-370f4c79-d2a5-4a1c-864c-34a2e8cf2ca8 tempest-ProjectMemberTests-1394267937 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2.d4fc55ac-62a1-406f-a39c-ec93bcf12b6d is being set with open permissions: ugo+rw
Nov 05 10:03:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-370f4c79-d2a5-4a1c-864c-34a2e8cf2ca8 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2.d4fc55ac-62a1-406f-a39c-ec93bcf12b6d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:20 devstack sudo[105233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2.d4fc55ac-62a1-406f-a39c-ec93bcf12b6d
Nov 05 10:03:20 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:20 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-370f4c79-d2a5-4a1c-864c-34a2e8cf2ca8 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2.d4fc55ac-62a1-406f-a39c-ec93bcf12b6d" returned: 0 in 0.264s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-370f4c79-d2a5-4a1c-864c-34a2e8cf2ca8 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:20 devstack sudo[105236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2.info
Nov 05 10:03:20 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:20 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-370f4c79-d2a5-4a1c-864c-34a2e8cf2ca8 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2.info" returned: 0 in 0.266s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:20 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-370f4c79-d2a5-4a1c-864c-34a2e8cf2ca8 tempest-ProjectMemberTests-1394267937 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2.info is being set with open permissions: ugo+rw
Nov 05 10:03:20 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-370f4c79-d2a5-4a1c-864c-34a2e8cf2ca8 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:20 devstack sudo[105239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2.info
Nov 05 10:03:20 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:21 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-370f4c79-d2a5-4a1c-864c-34a2e8cf2ca8 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2.info" returned: 0 in 0.258s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-370f4c79-d2a5-4a1c-864c-34a2e8cf2ca8 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.105s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:03:21 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-370f4c79-d2a5-4a1c-864c-34a2e8cf2ca8 tempest-ProjectMemberTests-1394267937 None] Create snapshot completed successfully
Nov 05 10:03:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-93f215ec-5348-4573-b2b0-9ece2368eaf0 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-d4fc55ac-62a1-406f-a39c-ec93bcf12b6d-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-93f215ec-5348-4573-b2b0-9ece2368eaf0 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-d4fc55ac-62a1-406f-a39c-ec93bcf12b6d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-93f215ec-5348-4573-b2b0-9ece2368eaf0 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-quobyte-cae59ee4-5126-4098-b4a3-6fa657fb9bc2" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-93f215ec-5348-4573-b2b0-9ece2368eaf0 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-cae59ee4-5126-4098-b4a3-6fa657fb9bc2" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-93f215ec-5348-4573-b2b0-9ece2368eaf0 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-quobyte-d4fc55ac-62a1-406f-a39c-ec93bcf12b6d" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:22 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-93f215ec-5348-4573-b2b0-9ece2368eaf0 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-d4fc55ac-62a1-406f-a39c-ec93bcf12b6d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-93f215ec-5348-4573-b2b0-9ece2368eaf0 tempest-ProjectMemberTests-1394267937 None] Deleting offline snapshot d4fc55ac-62a1-406f-a39c-ec93bcf12b6d of volume cae59ee4-5126-4098-b4a3-6fa657fb9bc2 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 10:03:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-93f215ec-5348-4573-b2b0-9ece2368eaf0 tempest-ProjectMemberTests-1394267937 None] snapshot_file for this snap is: volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2.d4fc55ac-62a1-406f-a39c-ec93bcf12b6d {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 10:03:22 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf97067-6f59-4112-99ba-c7248273e635]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:03:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-93f215ec-5348-4573-b2b0-9ece2368eaf0 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2.d4fc55ac-62a1-406f-a39c-ec93bcf12b6d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:22 devstack sudo[105242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2.d4fc55ac-62a1-406f-a39c-ec93bcf12b6d
Nov 05 10:03:22 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:22 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-93f215ec-5348-4573-b2b0-9ece2368eaf0 tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2.d4fc55ac-62a1-406f-a39c-ec93bcf12b6d" returned: 0 in 0.413s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:22 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-93f215ec-5348-4573-b2b0-9ece2368eaf0 tempest-ProjectMemberTests-1394267937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 10:03:22 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[57da2706-01d1-4b14-86c6-ec99a52b1910]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:03:22 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-93f215ec-5348-4573-b2b0-9ece2368eaf0 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:22 devstack sudo[105247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2
Nov 05 10:03:22 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:23 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-93f215ec-5348-4573-b2b0-9ece2368eaf0 tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2" returned: 0 in 0.387s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-93f215ec-5348-4573-b2b0-9ece2368eaf0 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2.d4fc55ac-62a1-406f-a39c-ec93bcf12b6d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:23 devstack sudo[105252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2.d4fc55ac-62a1-406f-a39c-ec93bcf12b6d
Nov 05 10:03:23 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:23 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-93f215ec-5348-4573-b2b0-9ece2368eaf0 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2.d4fc55ac-62a1-406f-a39c-ec93bcf12b6d" returned: 0 in 0.406s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-93f215ec-5348-4573-b2b0-9ece2368eaf0 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2.d4fc55ac-62a1-406f-a39c-ec93bcf12b6d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:23 devstack sudo[105257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2.d4fc55ac-62a1-406f-a39c-ec93bcf12b6d
Nov 05 10:03:23 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:23 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:23 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-93f215ec-5348-4573-b2b0-9ece2368eaf0 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2.d4fc55ac-62a1-406f-a39c-ec93bcf12b6d" returned: 0 in 0.266s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:23 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-93f215ec-5348-4573-b2b0-9ece2368eaf0 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-d4fc55ac-62a1-406f-a39c-ec93bcf12b6d" released by "_delete_snapshot" :: held 1.586s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:23 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-93f215ec-5348-4573-b2b0-9ece2368eaf0 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-cae59ee4-5126-4098-b4a3-6fa657fb9bc2" released by "delete_snapshot" :: held 1.612s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:24 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-93f215ec-5348-4573-b2b0-9ece2368eaf0 tempest-ProjectMemberTests-1394267937 None] Created reservations ['1cde1cd5-8afe-4f9b-a72a-ff5a959712ae', 'd160b4c4-6389-4d30-8c3d-24f6f3bc285e', '7c0f8575-cdd8-47ec-8801-0022ba3aa7f7', '7ad6f489-825c-4ae7-8998-6465324f2953'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:03:24 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-93f215ec-5348-4573-b2b0-9ece2368eaf0 tempest-ProjectMemberTests-1394267937 None] Delete snapshot completed successfully.
Nov 05 10:03:24 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-93f215ec-5348-4573-b2b0-9ece2368eaf0 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-d4fc55ac-62a1-406f-a39c-ec93bcf12b6d-delete_snapshot" released by "delete_snapshot" :: held 1.781s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:24 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-96f16b8c-ba57-4e76-b223-63acd3ee2e76 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-cae59ee4-5126-4098-b4a3-6fa657fb9bc2-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:24 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-96f16b8c-ba57-4e76-b223-63acd3ee2e76 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-cae59ee4-5126-4098-b4a3-6fa657fb9bc2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:24 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-96f16b8c-ba57-4e76-b223-63acd3ee2e76 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-quobyte-cae59ee4-5126-4098-b4a3-6fa657fb9bc2" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:24 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-96f16b8c-ba57-4e76-b223-63acd3ee2e76 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-cae59ee4-5126-4098-b4a3-6fa657fb9bc2" acquired by "delete_volume" :: waited 0.023s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:24 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af3159b-7ef5-4852-815b-bc90e32c9a20]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:03:24 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-96f16b8c-ba57-4e76-b223-63acd3ee2e76 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:24 devstack sudo[105261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2
Nov 05 10:03:24 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:25 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-96f16b8c-ba57-4e76-b223-63acd3ee2e76 tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2" returned: 0 in 0.399s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-96f16b8c-ba57-4e76-b223-63acd3ee2e76 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:25 devstack sudo[105267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2
Nov 05 10:03:25 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:25 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-96f16b8c-ba57-4e76-b223-63acd3ee2e76 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-cae59ee4-5126-4098-b4a3-6fa657fb9bc2" returned: 0 in 0.283s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:25 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-96f16b8c-ba57-4e76-b223-63acd3ee2e76 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-cae59ee4-5126-4098-b4a3-6fa657fb9bc2" released by "delete_volume" :: held 0.756s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:25 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-96f16b8c-ba57-4e76-b223-63acd3ee2e76 tempest-ProjectMemberTests-1394267937 None] Created reservations ['754987a8-1ce3-4764-8a61-57495cacdbeb', 'a7dd7731-6455-46ea-8ea8-f5ec3c7245f8', 'a29f4381-15da-4144-aa7e-5729ab27b5e0', 'b73d9f56-6397-4772-be9a-8c086fdb2b36'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:03:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-96f16b8c-ba57-4e76-b223-63acd3ee2e76 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:03:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-96f16b8c-ba57-4e76-b223-63acd3ee2e76 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:03:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-96f16b8c-ba57-4e76-b223-63acd3ee2e76 tempest-ProjectMemberTests-1394267937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:03:25 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-96f16b8c-ba57-4e76-b223-63acd3ee2e76 tempest-ProjectMemberTests-1394267937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:03:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-96f16b8c-ba57-4e76-b223-63acd3ee2e76 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:03:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-96f16b8c-ba57-4e76-b223-63acd3ee2e76 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:25 devstack sudo[105270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:03:25 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:25 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:25 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-96f16b8c-ba57-4e76-b223-63acd3ee2e76 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.282s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:25 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-96f16b8c-ba57-4e76-b223-63acd3ee2e76 tempest-ProjectMemberTests-1394267937 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:03:25 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-96f16b8c-ba57-4e76-b223-63acd3ee2e76 tempest-ProjectMemberTests-1394267937 None] Deleted volume successfully.
Nov 05 10:03:25 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-96f16b8c-ba57-4e76-b223-63acd3ee2e76 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-cae59ee4-5126-4098-b4a3-6fa657fb9bc2-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:26 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:03:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] Flow 'volume_create_manager' (5c00333a-fbbc-4625-ac54-85c21ae369d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:03:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49ef03cf-239a-44e2-99cf-5b2722816581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49ef03cf-239a-44e2-99cf-5b2722816581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-895556426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6f0652-1796-4f33-8685-064c320ebbff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e528f8801a4697bc8112c19f08f0c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:03:26Z,use_quota=True,user_id='db806d37a63442189c00f5196322142a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (094b24a1-a228-49e8-b641-48af7c8a0e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (094b24a1-a228-49e8-b641-48af7c8a0e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b78a939c-9374-4d06-8d19-d884bc412002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b78a939c-9374-4d06-8d19-d884bc412002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b6f0652-1796-4f33-8685-064c320ebbff', 'volume_name': 'volume-0b6f0652-1796-4f33-8685-064c320ebbff', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f052ae5-54f6-412d-9501-1a59fbe38a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f052ae5-54f6-412d-9501-1a59fbe38a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:26 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28cb9380-4c9a-429e-b0cf-90b9dc44d2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:26 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] Volume 0b6f0652-1796-4f33-8685-064c320ebbff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b6f0652-1796-4f33-8685-064c320ebbff', 'volume_size': 1}
Nov 05 10:03:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:03:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:03:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-895556426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6f0652-1796-4f33-8685-064c320ebbff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e528f8801a4697bc8112c19f08f0c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:03:26Z,use_quota=True,user_id='db806d37a63442189c00f5196322142a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:03:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] Creating volume 0b6f0652-1796-4f33-8685-064c320ebbff {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:03:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:03:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:03:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:03:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:03:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:03:26 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:03:26 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:03:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:26 devstack sudo[105273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff 1073741824
Nov 05 10:03:26 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:26 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff 1073741824" returned: 0 in 0.519s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:26 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:26 devstack sudo[105279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff
Nov 05 10:03:26 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:27 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff" returned: 0 in 0.264s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:27 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:03:27 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:03:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28cb9380-4c9a-429e-b0cf-90b9dc44d2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b6f0652-1796-4f33-8685-064c320ebbff', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24e692b8-9f4c-4db5-af97-a5f4db2231c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:27 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] Volume volume-0b6f0652-1796-4f33-8685-064c320ebbff (0b6f0652-1796-4f33-8685-064c320ebbff): created successfully
Nov 05 10:03:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24e692b8-9f4c-4db5-af97-a5f4db2231c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:27 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] Flow 'volume_create_manager' (5c00333a-fbbc-4625-ac54-85c21ae369d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:03:27 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-dbd43386-8afe-4c5f-bf82-2a872c044897 tempest-ProjectMemberTests-1394267937 None] Created volume successfully.
Nov 05 10:03:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8ba62641-84c8-4b00-b797-25d8947ce347 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:03:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8ba62641-84c8-4b00-b797-25d8947ce347 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:03:28 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-8ba62641-84c8-4b00-b797-25d8947ce347 tempest-ProjectMemberTests-1394267937 None] Creating offline snapshot 301c1058-4d81-46b8-b01f-a7a5429dc632 of volume 0b6f0652-1796-4f33-8685-064c320ebbff {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 10:03:28 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[4343414d-79e9-4913-ad09-3135d59daa6c]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:03:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8ba62641-84c8-4b00-b797-25d8947ce347 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:28 devstack sudo[105284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff
Nov 05 10:03:28 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:28 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8ba62641-84c8-4b00-b797-25d8947ce347 tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff" returned: 0 in 0.397s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:28 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8ba62641-84c8-4b00-b797-25d8947ce347 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff.301c1058-4d81-46b8-b01f-a7a5429dc632 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:28 devstack sudo[105290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff.301c1058-4d81-46b8-b01f-a7a5429dc632 1G
Nov 05 10:03:28 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:29 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8ba62641-84c8-4b00-b797-25d8947ce347 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff.301c1058-4d81-46b8-b01f-a7a5429dc632 1G" returned: 0 in 0.436s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8ba62641-84c8-4b00-b797-25d8947ce347 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b6f0652-1796-4f33-8685-064c320ebbff -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff.301c1058-4d81-46b8-b01f-a7a5429dc632 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:29 devstack sudo[105295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b6f0652-1796-4f33-8685-064c320ebbff -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff.301c1058-4d81-46b8-b01f-a7a5429dc632
Nov 05 10:03:29 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:29 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8ba62641-84c8-4b00-b797-25d8947ce347 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b6f0652-1796-4f33-8685-064c320ebbff -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff.301c1058-4d81-46b8-b01f-a7a5429dc632" returned: 0 in 0.301s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:29 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-8ba62641-84c8-4b00-b797-25d8947ce347 tempest-ProjectMemberTests-1394267937 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff.301c1058-4d81-46b8-b01f-a7a5429dc632 is being set with open permissions: ugo+rw
Nov 05 10:03:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8ba62641-84c8-4b00-b797-25d8947ce347 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff.301c1058-4d81-46b8-b01f-a7a5429dc632 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:29 devstack sudo[105300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff.301c1058-4d81-46b8-b01f-a7a5429dc632
Nov 05 10:03:29 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:29 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8ba62641-84c8-4b00-b797-25d8947ce347 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff.301c1058-4d81-46b8-b01f-a7a5429dc632" returned: 0 in 0.322s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:29 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8ba62641-84c8-4b00-b797-25d8947ce347 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:30 devstack sudo[105304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff.info
Nov 05 10:03:30 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:30 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8ba62641-84c8-4b00-b797-25d8947ce347 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff.info" returned: 0 in 0.264s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:30 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-8ba62641-84c8-4b00-b797-25d8947ce347 tempest-ProjectMemberTests-1394267937 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff.info is being set with open permissions: ugo+rw
Nov 05 10:03:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8ba62641-84c8-4b00-b797-25d8947ce347 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:30 devstack sudo[105307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff.info
Nov 05 10:03:30 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:30 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-8ba62641-84c8-4b00-b797-25d8947ce347 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff.info" returned: 0 in 0.255s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-8ba62641-84c8-4b00-b797-25d8947ce347 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.080s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:03:30 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-8ba62641-84c8-4b00-b797-25d8947ce347 tempest-ProjectMemberTests-1394267937 None] Create snapshot completed successfully
Nov 05 10:03:30 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:03:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] Flow 'volume_create_manager' (4ef015bf-9843-4f61-bd41-ac9da6f01c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:03:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (967cbe57-fd72-4d2e-9744-6d4fbe35b79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (967cbe57-fd72-4d2e-9744-6d4fbe35b79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1747423665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6daef5c-64d3-4d3f-9b66-40516b330ed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='028138d1bdb0439987352e8a472ce664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:03:31Z,use_quota=True,user_id='b45b0a29080e469fbd8be5c5f5d7b0a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d9a7abf-58ce-40e9-8d4f-340e8135eb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d9a7abf-58ce-40e9-8d4f-340e8135eb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a717063-bffd-40fe-88bd-cfac80760b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a717063-bffd-40fe-88bd-cfac80760b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6daef5c-64d3-4d3f-9b66-40516b330ed1', 'volume_name': 'volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d4ec101-c74a-4c86-bc39-74c51a57e959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d4ec101-c74a-4c86-bc39-74c51a57e959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:30 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04d55184-2a7a-4ae1-8bc0-a4b7c0182e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:30 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] Volume d6daef5c-64d3-4d3f-9b66-40516b330ed1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1', 'volume_size': 1}
Nov 05 10:03:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:03:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:03:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1747423665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6daef5c-64d3-4d3f-9b66-40516b330ed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='028138d1bdb0439987352e8a472ce664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:03:31Z,use_quota=True,user_id='b45b0a29080e469fbd8be5c5f5d7b0a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:03:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] Creating volume d6daef5c-64d3-4d3f-9b66-40516b330ed1 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:03:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:03:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:03:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:03:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:03:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:03:30 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:03:30 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:03:30 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:30 devstack sudo[105310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1 1073741824
Nov 05 10:03:30 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:31 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1 1073741824" returned: 0 in 0.427s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:31 devstack sudo[105315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1
Nov 05 10:03:31 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:31 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1" returned: 0 in 0.273s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:03:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:03:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04d55184-2a7a-4ae1-8bc0-a4b7c0182e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8470075-c58f-4d7c-9877-8184f3141377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:31 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] Volume volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1 (d6daef5c-64d3-4d3f-9b66-40516b330ed1): created successfully
Nov 05 10:03:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8470075-c58f-4d7c-9877-8184f3141377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:31 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] Flow 'volume_create_manager' (4ef015bf-9843-4f61-bd41-ac9da6f01c98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:03:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-07a6c0d2-803a-4a8e-beaa-b45419c46679 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-301c1058-4d81-46b8-b01f-a7a5429dc632-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:31 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-e225d8d8-28ea-40c4-bdb0-9f4206b91217 tempest-SnapshotDependencyTests-154617986 None] Created volume successfully.
Nov 05 10:03:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-07a6c0d2-803a-4a8e-beaa-b45419c46679 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-301c1058-4d81-46b8-b01f-a7a5429dc632-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-07a6c0d2-803a-4a8e-beaa-b45419c46679 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-quobyte-0b6f0652-1796-4f33-8685-064c320ebbff" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-07a6c0d2-803a-4a8e-beaa-b45419c46679 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-0b6f0652-1796-4f33-8685-064c320ebbff" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-07a6c0d2-803a-4a8e-beaa-b45419c46679 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-quobyte-301c1058-4d81-46b8-b01f-a7a5429dc632" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:31 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-07a6c0d2-803a-4a8e-beaa-b45419c46679 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-301c1058-4d81-46b8-b01f-a7a5429dc632" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-07a6c0d2-803a-4a8e-beaa-b45419c46679 tempest-ProjectMemberTests-1394267937 None] Deleting offline snapshot 301c1058-4d81-46b8-b01f-a7a5429dc632 of volume 0b6f0652-1796-4f33-8685-064c320ebbff {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 10:03:31 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-07a6c0d2-803a-4a8e-beaa-b45419c46679 tempest-ProjectMemberTests-1394267937 None] snapshot_file for this snap is: volume-0b6f0652-1796-4f33-8685-064c320ebbff.301c1058-4d81-46b8-b01f-a7a5429dc632 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 10:03:31 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bb892c-6125-48ef-9344-0806ad644255]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:03:31 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-07a6c0d2-803a-4a8e-beaa-b45419c46679 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff.301c1058-4d81-46b8-b01f-a7a5429dc632 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:31 devstack sudo[105318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff.301c1058-4d81-46b8-b01f-a7a5429dc632
Nov 05 10:03:31 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0363d6e3-b7b8-4f76-82b1-d2906298b432 tempest-SnapshotDependencyTests-154617986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:03:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0363d6e3-b7b8-4f76-82b1-d2906298b432 tempest-SnapshotDependencyTests-154617986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:03:32 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-0363d6e3-b7b8-4f76-82b1-d2906298b432 tempest-SnapshotDependencyTests-154617986 None] Creating offline snapshot a831479d-b64a-4915-a0f0-f6342a728ce5 of volume d6daef5c-64d3-4d3f-9b66-40516b330ed1 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 10:03:32 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[54546c51-300d-4df6-ad20-c518bd0d04e1]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:03:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0363d6e3-b7b8-4f76-82b1-d2906298b432 tempest-SnapshotDependencyTests-154617986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:32 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-07a6c0d2-803a-4a8e-beaa-b45419c46679 tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff.301c1058-4d81-46b8-b01f-a7a5429dc632" returned: 0 in 0.428s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:32 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-07a6c0d2-803a-4a8e-beaa-b45419c46679 tempest-ProjectMemberTests-1394267937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b6f0652-1796-4f33-8685-064c320ebbff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 10:03:32 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43b4357-d1ef-41aa-9389-a26efed3547f]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:03:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-07a6c0d2-803a-4a8e-beaa-b45419c46679 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:32 devstack sudo[105322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1
Nov 05 10:03:32 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:32 devstack sudo[105325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff
Nov 05 10:03:32 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:32 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0363d6e3-b7b8-4f76-82b1-d2906298b432 tempest-SnapshotDependencyTests-154617986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1" returned: 0 in 0.406s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0363d6e3-b7b8-4f76-82b1-d2906298b432 tempest-SnapshotDependencyTests-154617986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1.a831479d-b64a-4915-a0f0-f6342a728ce5 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:32 devstack sudo[105330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1.a831479d-b64a-4915-a0f0-f6342a728ce5 1G
Nov 05 10:03:32 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:32 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-07a6c0d2-803a-4a8e-beaa-b45419c46679 tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff" returned: 0 in 0.398s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-07a6c0d2-803a-4a8e-beaa-b45419c46679 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff.301c1058-4d81-46b8-b01f-a7a5429dc632 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:32 devstack sudo[105335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff.301c1058-4d81-46b8-b01f-a7a5429dc632
Nov 05 10:03:32 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:32 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0363d6e3-b7b8-4f76-82b1-d2906298b432 tempest-SnapshotDependencyTests-154617986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1.a831479d-b64a-4915-a0f0-f6342a728ce5 1G" returned: 0 in 0.447s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:32 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0363d6e3-b7b8-4f76-82b1-d2906298b432 tempest-SnapshotDependencyTests-154617986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1.a831479d-b64a-4915-a0f0-f6342a728ce5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:33 devstack sudo[105344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1.a831479d-b64a-4915-a0f0-f6342a728ce5
Nov 05 10:03:33 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:33 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-07a6c0d2-803a-4a8e-beaa-b45419c46679 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff.301c1058-4d81-46b8-b01f-a7a5429dc632" returned: 0 in 0.386s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-07a6c0d2-803a-4a8e-beaa-b45419c46679 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff.301c1058-4d81-46b8-b01f-a7a5429dc632 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:33 devstack sudo[105346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff.301c1058-4d81-46b8-b01f-a7a5429dc632
Nov 05 10:03:33 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:33 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-07a6c0d2-803a-4a8e-beaa-b45419c46679 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff.301c1058-4d81-46b8-b01f-a7a5429dc632" returned: 0 in 0.260s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:33 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0363d6e3-b7b8-4f76-82b1-d2906298b432 tempest-SnapshotDependencyTests-154617986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1.a831479d-b64a-4915-a0f0-f6342a728ce5" returned: 0 in 0.347s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:33 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-0363d6e3-b7b8-4f76-82b1-d2906298b432 tempest-SnapshotDependencyTests-154617986 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1.a831479d-b64a-4915-a0f0-f6342a728ce5 is being set with open permissions: ugo+rw
Nov 05 10:03:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0363d6e3-b7b8-4f76-82b1-d2906298b432 tempest-SnapshotDependencyTests-154617986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1.a831479d-b64a-4915-a0f0-f6342a728ce5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-07a6c0d2-803a-4a8e-beaa-b45419c46679 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-301c1058-4d81-46b8-b01f-a7a5429dc632" released by "_delete_snapshot" :: held 1.607s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-07a6c0d2-803a-4a8e-beaa-b45419c46679 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-0b6f0652-1796-4f33-8685-064c320ebbff" released by "delete_snapshot" :: held 1.645s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:33 devstack sudo[105352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1.a831479d-b64a-4915-a0f0-f6342a728ce5
Nov 05 10:03:33 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:33 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-07a6c0d2-803a-4a8e-beaa-b45419c46679 tempest-ProjectMemberTests-1394267937 None] Created reservations ['3ed4d806-9aec-48f2-b264-1902fd39eadb', '8931711f-6df4-4125-a3c6-556296b65343', '15b7766d-890a-440f-a4a5-d208ff9049b4', 'f5b7469c-fff4-4e53-870d-b03d880af11a'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:03:33 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-07a6c0d2-803a-4a8e-beaa-b45419c46679 tempest-ProjectMemberTests-1394267937 None] Delete snapshot completed successfully.
Nov 05 10:03:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-07a6c0d2-803a-4a8e-beaa-b45419c46679 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-301c1058-4d81-46b8-b01f-a7a5429dc632-delete_snapshot" released by "delete_snapshot" :: held 1.803s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:33 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0363d6e3-b7b8-4f76-82b1-d2906298b432 tempest-SnapshotDependencyTests-154617986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1.a831479d-b64a-4915-a0f0-f6342a728ce5" returned: 0 in 0.278s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0363d6e3-b7b8-4f76-82b1-d2906298b432 tempest-SnapshotDependencyTests-154617986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:33 devstack sudo[105355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1.info
Nov 05 10:03:33 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-868fc559-c3c3-4efd-bc8c-ddc181e999e4 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-0b6f0652-1796-4f33-8685-064c320ebbff-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-868fc559-c3c3-4efd-bc8c-ddc181e999e4 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-0b6f0652-1796-4f33-8685-064c320ebbff-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:33 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0363d6e3-b7b8-4f76-82b1-d2906298b432 tempest-SnapshotDependencyTests-154617986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1.info" returned: 0 in 0.282s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:33 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-0363d6e3-b7b8-4f76-82b1-d2906298b432 tempest-SnapshotDependencyTests-154617986 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1.info is being set with open permissions: ugo+rw
Nov 05 10:03:33 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0363d6e3-b7b8-4f76-82b1-d2906298b432 tempest-SnapshotDependencyTests-154617986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-868fc559-c3c3-4efd-bc8c-ddc181e999e4 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-quobyte-0b6f0652-1796-4f33-8685-064c320ebbff" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:33 devstack sudo[105358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1.info
Nov 05 10:03:33 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:33 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-868fc559-c3c3-4efd-bc8c-ddc181e999e4 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-0b6f0652-1796-4f33-8685-064c320ebbff" acquired by "delete_volume" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:34 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ccbce6-5827-4ad3-b686-278cc921cefb]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:03:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-868fc559-c3c3-4efd-bc8c-ddc181e999e4 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:34 devstack sudo[105360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff
Nov 05 10:03:34 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:34 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-0363d6e3-b7b8-4f76-82b1-d2906298b432 tempest-SnapshotDependencyTests-154617986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1.info" returned: 0 in 0.272s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-0363d6e3-b7b8-4f76-82b1-d2906298b432 tempest-SnapshotDependencyTests-154617986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.148s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:03:34 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-0363d6e3-b7b8-4f76-82b1-d2906298b432 tempest-SnapshotDependencyTests-154617986 None] Create snapshot completed successfully
Nov 05 10:03:34 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-868fc559-c3c3-4efd-bc8c-ddc181e999e4 tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff" returned: 0 in 0.405s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-868fc559-c3c3-4efd-bc8c-ddc181e999e4 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:34 devstack sudo[105366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff
Nov 05 10:03:34 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:34 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-868fc559-c3c3-4efd-bc8c-ddc181e999e4 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0b6f0652-1796-4f33-8685-064c320ebbff" returned: 0 in 0.268s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:34 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-868fc559-c3c3-4efd-bc8c-ddc181e999e4 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-0b6f0652-1796-4f33-8685-064c320ebbff" released by "delete_volume" :: held 0.745s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:34 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-868fc559-c3c3-4efd-bc8c-ddc181e999e4 tempest-ProjectMemberTests-1394267937 None] Created reservations ['41ce01b0-cb66-4005-bad4-ba5b2f3e274e', '93ee35b6-8aa8-4fc7-904e-59c9bfbf673d', '330b430d-6896-4d21-9287-8310c0654340', 'ad902f9e-ff71-4111-99f5-8d9f9bd68bf9'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:03:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-868fc559-c3c3-4efd-bc8c-ddc181e999e4 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:03:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-868fc559-c3c3-4efd-bc8c-ddc181e999e4 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:03:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-868fc559-c3c3-4efd-bc8c-ddc181e999e4 tempest-ProjectMemberTests-1394267937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:03:34 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-868fc559-c3c3-4efd-bc8c-ddc181e999e4 tempest-ProjectMemberTests-1394267937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:03:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-868fc559-c3c3-4efd-bc8c-ddc181e999e4 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:03:34 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-868fc559-c3c3-4efd-bc8c-ddc181e999e4 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:34 devstack sudo[105369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:03:34 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:35 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-868fc559-c3c3-4efd-bc8c-ddc181e999e4 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.271s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:35 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-868fc559-c3c3-4efd-bc8c-ddc181e999e4 tempest-ProjectMemberTests-1394267937 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:03:35 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-868fc559-c3c3-4efd-bc8c-ddc181e999e4 tempest-ProjectMemberTests-1394267937 None] Deleted volume successfully.
Nov 05 10:03:35 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-868fc559-c3c3-4efd-bc8c-ddc181e999e4 tempest-ProjectMemberTests-1394267937 None] Lock "cinder-0b6f0652-1796-4f33-8685-064c320ebbff-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:35 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:03:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] Flow 'volume_create_manager' (1642ce1d-2d68-4a44-a71d-b3cb0b0437f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:03:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e885cd5-0ca1-4f2d-bc6b-9ee9eada1598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e885cd5-0ca1-4f2d-bc6b-9ee9eada1598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1596897843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41621fbe-ed1f-47a8-9bf0-72e85a9d29a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e528f8801a4697bc8112c19f08f0c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:03:36Z,use_quota=True,user_id='db806d37a63442189c00f5196322142a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040c0cc8-05f7-4360-9d4b-c41e49d32b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040c0cc8-05f7-4360-9d4b-c41e49d32b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59fe4438-4ec4-4eab-a3e4-34a5f8f4552a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59fe4438-4ec4-4eab-a3e4-34a5f8f4552a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41621fbe-ed1f-47a8-9bf0-72e85a9d29a2', 'volume_name': 'volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (745a1c59-aa3e-4cbf-9e1b-3e8dcb1aa0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (745a1c59-aa3e-4cbf-9e1b-3e8dcb1aa0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:35 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20fe16db-787c-4ac0-89b5-65cec5e64e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:35 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] Volume 41621fbe-ed1f-47a8-9bf0-72e85a9d29a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2', 'volume_size': 1}
Nov 05 10:03:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:03:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:03:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1596897843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41621fbe-ed1f-47a8-9bf0-72e85a9d29a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e528f8801a4697bc8112c19f08f0c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:03:36Z,use_quota=True,user_id='db806d37a63442189c00f5196322142a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:03:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] Creating volume 41621fbe-ed1f-47a8-9bf0-72e85a9d29a2 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:03:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:03:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:03:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:03:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:03:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:03:35 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:03:35 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:03:35 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:35 devstack sudo[105373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2 1073741824
Nov 05 10:03:35 devstack sudo[105373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:35 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Flow 'volume_create_manager' (838c0ac3-4bdb-454a-96b4-e96981641fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3824a0f2-bb05-42de-a022-a7d241e9111f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3824a0f2-bb05-42de-a022-a7d241e9111f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c2a466b-e30d-4266-85b7-fc5b53e6e3b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='028138d1bdb0439987352e8a472ce664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a831479d-b64a-4915-a0f0-f6342a728ce5,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:03:36Z,use_quota=True,user_id='b45b0a29080e469fbd8be5c5f5d7b0a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e836d1d-3a5c-4094-9452-b409ccd21dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e836d1d-3a5c-4094-9452-b409ccd21dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (250100b5-8e9d-491b-a7f8-afdc2c2a00e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (250100b5-8e9d-491b-a7f8-afdc2c2a00e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0c2a466b-e30d-4266-85b7-fc5b53e6e3b3', 'volume_name': 'volume-0c2a466b-e30d-4266-85b7-fc5b53e6e3b3', 'volume_size': 1, 'snapshot_id': 'a831479d-b64a-4915-a0f0-f6342a728ce5'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (280b5760-6bc2-482c-a9df-821f455842a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (280b5760-6bc2-482c-a9df-821f455842a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e24872-4986-449d-828d-d514790e4046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:36 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Volume 0c2a466b-e30d-4266-85b7-fc5b53e6e3b3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0c2a466b-e30d-4266-85b7-fc5b53e6e3b3', 'volume_size': 1, 'snapshot_id': 'a831479d-b64a-4915-a0f0-f6342a728ce5'}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:03:36 devstack sudo[105373]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2 1073741824" returned: 0 in 0.461s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:36 devstack sudo[105379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2
Nov 05 10:03:36 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:36 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2" returned: 0 in 0.245s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.420s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Acquiring lock "cinder-quobyte-a831479d-b64a-4915-a0f0-f6342a728ce5-0c2a466b-e30d-4266-85b7-fc5b53e6e3b3" by "_create_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20fe16db-787c-4ac0-89b5-65cec5e64e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91239a8-ecba-4d45-94da-8563b8e91f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Lock "cinder-quobyte-a831479d-b64a-4915-a0f0-f6342a728ce5-0c2a466b-e30d-4266-85b7-fc5b53e6e3b3" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Creating volume 0c2a466b-e30d-4266-85b7-fc5b53e6e3b3 from snapshot a831479d-b64a-4915-a0f0-f6342a728ce5 {{(pid=86649) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Acquiring lock "cinder-quobyte-0c2a466b-e30d-4266-85b7-fc5b53e6e3b3" by "_copy_volume_from_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:36 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] Volume volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2 (41621fbe-ed1f-47a8-9bf0-72e85a9d29a2): created successfully
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91239a8-ecba-4d45-94da-8563b8e91f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] Flow 'volume_create_manager' (1642ce1d-2d68-4a44-a71d-b3cb0b0437f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Lock "cinder-quobyte-0c2a466b-e30d-4266-85b7-fc5b53e6e3b3" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] snapshot: a831479d-b64a-4915-a0f0-f6342a728ce5, volume: 0c2a466b-e30d-4266-85b7-fc5b53e6e3b3,  {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 10:03:36 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-e769a19d-40af-427e-a55c-a53f147646d9 tempest-ProjectMemberTests-1394267937 None] Created volume successfully.
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7a7bdd-d000-4aa3-bae4-3fdb5ea26efa]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:03:36 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1.a831479d-b64a-4915-a0f0-f6342a728ce5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:36 devstack sudo[105382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1.a831479d-b64a-4915-a0f0-f6342a728ce5
Nov 05 10:03:36 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:37 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1.a831479d-b64a-4915-a0f0-f6342a728ce5" returned: 0 in 0.361s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 10:03:37 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9513366-5895-45e0-bc46-f118c6c68e55]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:03:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:37 devstack sudo[105387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1
Nov 05 10:03:37 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:37 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1" returned: 0 in 0.361s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1 {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 10:03:37 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Creating direct copy from snapshot {{(pid=86649) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 10:03:37 devstack cinder-volume[86649]: DEBUG cinder.utils [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Path /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0c2a466b-e30d-4266-85b7-fc5b53e6e3b3 not found in is_blk_device check {{(pid=86649) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 10:03:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0c2a466b-e30d-4266-85b7-fc5b53e6e3b3 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:37 devstack sudo[105392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0c2a466b-e30d-4266-85b7-fc5b53e6e3b3
Nov 05 10:03:37 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:37 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cd5c9b3a-92db-43eb-bec1-f95359cf0805 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:03:43 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0c2a466b-e30d-4266-85b7-fc5b53e6e3b3" returned: 0 in 6.380s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:43 devstack cinder-volume[86649]: DEBUG cinder.image.image_utils [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Image conversion details: src /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1, size 1024.00 MB, duration 6.38 sec, destination /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0c2a466b-e30d-4266-85b7-fc5b53e6e3b3 {{(pid=86649) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 10:03:43 devstack cinder-volume[86649]: INFO cinder.image.image_utils [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Converted 1024.00 MB image at 160.48 MB/s
Nov 05 10:03:43 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0c2a466b-e30d-4266-85b7-fc5b53e6e3b3 is being set with open permissions: ugo+rw
Nov 05 10:03:43 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0c2a466b-e30d-4266-85b7-fc5b53e6e3b3 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:43 devstack sudo[105412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0c2a466b-e30d-4266-85b7-fc5b53e6e3b3
Nov 05 10:03:43 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:44 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0c2a466b-e30d-4266-85b7-fc5b53e6e3b3" returned: 0 in 0.236s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Lock "cinder-quobyte-0c2a466b-e30d-4266-85b7-fc5b53e6e3b3" released by "_copy_volume_from_snapshot" :: held 7.423s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Lock "cinder-quobyte-a831479d-b64a-4915-a0f0-f6342a728ce5-0c2a466b-e30d-4266-85b7-fc5b53e6e3b3" released by "_create_volume_from_snapshot" :: held 7.498s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.534s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:03:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cd5c9b3a-92db-43eb-bec1-f95359cf0805 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.165s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:03:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-cd5c9b3a-92db-43eb-bec1-f95359cf0805 tempest-ProjectMemberTests-1394267937 None] Creating offline snapshot 08b559d7-d69b-493e-9000-8842988fd0a4 of volume 41621fbe-ed1f-47a8-9bf0-72e85a9d29a2 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 10:03:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e24872-4986-449d-828d-d514790e4046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c2a466b-e30d-4266-85b7-fc5b53e6e3b3', 'volume_size': 1, 'snapshot_id': 'a831479d-b64a-4915-a0f0-f6342a728ce5'}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c7c9cc-5549-4ff6-967e-a38a6a98f12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:44 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ba5fc5-fd58-4142-a543-ed3e54837dcd]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:03:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cd5c9b3a-92db-43eb-bec1-f95359cf0805 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:44 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Volume volume-0c2a466b-e30d-4266-85b7-fc5b53e6e3b3 (0c2a466b-e30d-4266-85b7-fc5b53e6e3b3): created successfully
Nov 05 10:03:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c7c9cc-5549-4ff6-967e-a38a6a98f12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:44 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Flow 'volume_create_manager' (838c0ac3-4bdb-454a-96b4-e96981641fc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:03:44 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-21dcd307-9b2f-46ca-b229-28bf8d240cf3 tempest-SnapshotDependencyTests-154617986 None] Created volume successfully.
Nov 05 10:03:44 devstack sudo[105415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2
Nov 05 10:03:44 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:44 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cd5c9b3a-92db-43eb-bec1-f95359cf0805 tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2" returned: 0 in 0.375s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cd5c9b3a-92db-43eb-bec1-f95359cf0805 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2.08b559d7-d69b-493e-9000-8842988fd0a4 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:44 devstack sudo[105420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2.08b559d7-d69b-493e-9000-8842988fd0a4 1G
Nov 05 10:03:44 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2a53afea-636c-4540-b0f4-9a9402249e8e tempest-SnapshotDependencyTests-154617986 None] Acquiring lock "cinder-a831479d-b64a-4915-a0f0-f6342a728ce5-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2a53afea-636c-4540-b0f4-9a9402249e8e tempest-SnapshotDependencyTests-154617986 None] Lock "cinder-a831479d-b64a-4915-a0f0-f6342a728ce5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2a53afea-636c-4540-b0f4-9a9402249e8e tempest-SnapshotDependencyTests-154617986 None] Acquiring lock "cinder-quobyte-d6daef5c-64d3-4d3f-9b66-40516b330ed1" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2a53afea-636c-4540-b0f4-9a9402249e8e tempest-SnapshotDependencyTests-154617986 None] Lock "cinder-quobyte-d6daef5c-64d3-4d3f-9b66-40516b330ed1" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2a53afea-636c-4540-b0f4-9a9402249e8e tempest-SnapshotDependencyTests-154617986 None] Acquiring lock "cinder-quobyte-a831479d-b64a-4915-a0f0-f6342a728ce5" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:44 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2a53afea-636c-4540-b0f4-9a9402249e8e tempest-SnapshotDependencyTests-154617986 None] Lock "cinder-quobyte-a831479d-b64a-4915-a0f0-f6342a728ce5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-2a53afea-636c-4540-b0f4-9a9402249e8e tempest-SnapshotDependencyTests-154617986 None] Deleting offline snapshot a831479d-b64a-4915-a0f0-f6342a728ce5 of volume d6daef5c-64d3-4d3f-9b66-40516b330ed1 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 10:03:44 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-2a53afea-636c-4540-b0f4-9a9402249e8e tempest-SnapshotDependencyTests-154617986 None] snapshot_file for this snap is: volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1.a831479d-b64a-4915-a0f0-f6342a728ce5 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 10:03:44 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8b8270-2a0c-4e3d-a47d-01a4468519dd]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:03:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2a53afea-636c-4540-b0f4-9a9402249e8e tempest-SnapshotDependencyTests-154617986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1.a831479d-b64a-4915-a0f0-f6342a728ce5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:44 devstack sudo[105425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1.a831479d-b64a-4915-a0f0-f6342a728ce5
Nov 05 10:03:44 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:44 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cd5c9b3a-92db-43eb-bec1-f95359cf0805 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2.08b559d7-d69b-493e-9000-8842988fd0a4 1G" returned: 0 in 0.440s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:44 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cd5c9b3a-92db-43eb-bec1-f95359cf0805 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2.08b559d7-d69b-493e-9000-8842988fd0a4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:44 devstack sudo[105427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2.08b559d7-d69b-493e-9000-8842988fd0a4
Nov 05 10:03:44 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:45 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2a53afea-636c-4540-b0f4-9a9402249e8e tempest-SnapshotDependencyTests-154617986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1.a831479d-b64a-4915-a0f0-f6342a728ce5" returned: 0 in 0.375s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:45 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-2a53afea-636c-4540-b0f4-9a9402249e8e tempest-SnapshotDependencyTests-154617986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 10:03:45 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ace2f8-4474-4eea-9f03-4e9411a09a86]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:03:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2a53afea-636c-4540-b0f4-9a9402249e8e tempest-SnapshotDependencyTests-154617986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:45 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cd5c9b3a-92db-43eb-bec1-f95359cf0805 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2.08b559d7-d69b-493e-9000-8842988fd0a4" returned: 0 in 0.311s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:45 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-cd5c9b3a-92db-43eb-bec1-f95359cf0805 tempest-ProjectMemberTests-1394267937 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2.08b559d7-d69b-493e-9000-8842988fd0a4 is being set with open permissions: ugo+rw
Nov 05 10:03:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cd5c9b3a-92db-43eb-bec1-f95359cf0805 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2.08b559d7-d69b-493e-9000-8842988fd0a4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:45 devstack sudo[105436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2.08b559d7-d69b-493e-9000-8842988fd0a4
Nov 05 10:03:45 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:45 devstack sudo[105435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1
Nov 05 10:03:45 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:45 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cd5c9b3a-92db-43eb-bec1-f95359cf0805 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2.08b559d7-d69b-493e-9000-8842988fd0a4" returned: 0 in 0.267s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cd5c9b3a-92db-43eb-bec1-f95359cf0805 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:45 devstack sudo[105442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2.info
Nov 05 10:03:45 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:45 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2a53afea-636c-4540-b0f4-9a9402249e8e tempest-SnapshotDependencyTests-154617986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1" returned: 0 in 0.538s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2a53afea-636c-4540-b0f4-9a9402249e8e tempest-SnapshotDependencyTests-154617986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1.a831479d-b64a-4915-a0f0-f6342a728ce5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:45 devstack sudo[105445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1.a831479d-b64a-4915-a0f0-f6342a728ce5
Nov 05 10:03:45 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:45 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cd5c9b3a-92db-43eb-bec1-f95359cf0805 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2.info" returned: 0 in 0.292s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:45 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-cd5c9b3a-92db-43eb-bec1-f95359cf0805 tempest-ProjectMemberTests-1394267937 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2.info is being set with open permissions: ugo+rw
Nov 05 10:03:45 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cd5c9b3a-92db-43eb-bec1-f95359cf0805 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:45 devstack sudo[105448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2.info
Nov 05 10:03:45 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:46 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-cd5c9b3a-92db-43eb-bec1-f95359cf0805 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2.info" returned: 0 in 0.253s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:46 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-cd5c9b3a-92db-43eb-bec1-f95359cf0805 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.042s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:03:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2a53afea-636c-4540-b0f4-9a9402249e8e tempest-SnapshotDependencyTests-154617986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1.a831479d-b64a-4915-a0f0-f6342a728ce5" returned: 0 in 0.396s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2a53afea-636c-4540-b0f4-9a9402249e8e tempest-SnapshotDependencyTests-154617986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1.a831479d-b64a-4915-a0f0-f6342a728ce5 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:46 devstack sudo[105454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1.a831479d-b64a-4915-a0f0-f6342a728ce5
Nov 05 10:03:46 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:46 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-cd5c9b3a-92db-43eb-bec1-f95359cf0805 tempest-ProjectMemberTests-1394267937 None] Create snapshot completed successfully
Nov 05 10:03:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5726cef7-c254-4992-b7dc-50dde792200b tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-08b559d7-d69b-493e-9000-8842988fd0a4-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5726cef7-c254-4992-b7dc-50dde792200b tempest-ProjectMemberTests-1394267937 None] Lock "cinder-08b559d7-d69b-493e-9000-8842988fd0a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5726cef7-c254-4992-b7dc-50dde792200b tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-quobyte-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5726cef7-c254-4992-b7dc-50dde792200b tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5726cef7-c254-4992-b7dc-50dde792200b tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-quobyte-08b559d7-d69b-493e-9000-8842988fd0a4" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5726cef7-c254-4992-b7dc-50dde792200b tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-08b559d7-d69b-493e-9000-8842988fd0a4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-5726cef7-c254-4992-b7dc-50dde792200b tempest-ProjectMemberTests-1394267937 None] Deleting offline snapshot 08b559d7-d69b-493e-9000-8842988fd0a4 of volume 41621fbe-ed1f-47a8-9bf0-72e85a9d29a2 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 10:03:46 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-5726cef7-c254-4992-b7dc-50dde792200b tempest-ProjectMemberTests-1394267937 None] snapshot_file for this snap is: volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2.08b559d7-d69b-493e-9000-8842988fd0a4 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 10:03:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-2a53afea-636c-4540-b0f4-9a9402249e8e tempest-SnapshotDependencyTests-154617986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1.a831479d-b64a-4915-a0f0-f6342a728ce5" returned: 0 in 0.270s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:46 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23ed62f-2b5c-4b07-98c3-4e4962f5fee1]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:03:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5726cef7-c254-4992-b7dc-50dde792200b tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2.08b559d7-d69b-493e-9000-8842988fd0a4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2a53afea-636c-4540-b0f4-9a9402249e8e tempest-SnapshotDependencyTests-154617986 None] Lock "cinder-quobyte-a831479d-b64a-4915-a0f0-f6342a728ce5" released by "_delete_snapshot" :: held 1.695s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2a53afea-636c-4540-b0f4-9a9402249e8e tempest-SnapshotDependencyTests-154617986 None] Lock "cinder-quobyte-d6daef5c-64d3-4d3f-9b66-40516b330ed1" released by "delete_snapshot" :: held 1.721s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:46 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-2a53afea-636c-4540-b0f4-9a9402249e8e tempest-SnapshotDependencyTests-154617986 None] Created reservations ['3397de36-67e0-40a5-9605-3d5c9aa0e31b', 'a695f4cb-f123-41fc-a5a4-4319a693c725', 'a539aabd-b2d6-4f0f-92c6-62cd350d9ad4', '1ace0d03-0052-4b5c-bf42-1a2b3945da3e'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:03:46 devstack sudo[105457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2.08b559d7-d69b-493e-9000-8842988fd0a4
Nov 05 10:03:46 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:46 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-2a53afea-636c-4540-b0f4-9a9402249e8e tempest-SnapshotDependencyTests-154617986 None] Delete snapshot completed successfully.
Nov 05 10:03:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-2a53afea-636c-4540-b0f4-9a9402249e8e tempest-SnapshotDependencyTests-154617986 None] Lock "cinder-a831479d-b64a-4915-a0f0-f6342a728ce5-delete_snapshot" released by "delete_snapshot" :: held 1.868s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:46 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5726cef7-c254-4992-b7dc-50dde792200b tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2.08b559d7-d69b-493e-9000-8842988fd0a4" returned: 0 in 0.409s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:46 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-5726cef7-c254-4992-b7dc-50dde792200b tempest-ProjectMemberTests-1394267937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 10:03:46 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6ef9b6-fa45-4980-bbf4-d3f479a3dd31]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:03:46 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5726cef7-c254-4992-b7dc-50dde792200b tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6b6da3a1-411d-4b96-a3b8-1652a0215e81 tempest-SnapshotDependencyTests-154617986 None] Acquiring lock "cinder-d6daef5c-64d3-4d3f-9b66-40516b330ed1-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6b6da3a1-411d-4b96-a3b8-1652a0215e81 tempest-SnapshotDependencyTests-154617986 None] Lock "cinder-d6daef5c-64d3-4d3f-9b66-40516b330ed1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6b6da3a1-411d-4b96-a3b8-1652a0215e81 tempest-SnapshotDependencyTests-154617986 None] Acquiring lock "cinder-quobyte-d6daef5c-64d3-4d3f-9b66-40516b330ed1" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:46 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6b6da3a1-411d-4b96-a3b8-1652a0215e81 tempest-SnapshotDependencyTests-154617986 None] Lock "cinder-quobyte-d6daef5c-64d3-4d3f-9b66-40516b330ed1" acquired by "delete_volume" :: waited 0.014s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:46 devstack sudo[105463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2
Nov 05 10:03:46 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:47 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[06054008-206f-4088-afe2-1c471c704060]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:03:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6b6da3a1-411d-4b96-a3b8-1652a0215e81 tempest-SnapshotDependencyTests-154617986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:47 devstack sudo[105465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1
Nov 05 10:03:47 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:47 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5726cef7-c254-4992-b7dc-50dde792200b tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2" returned: 0 in 0.396s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5726cef7-c254-4992-b7dc-50dde792200b tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2.08b559d7-d69b-493e-9000-8842988fd0a4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:47 devstack sudo[105470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2.08b559d7-d69b-493e-9000-8842988fd0a4
Nov 05 10:03:47 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:47 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6b6da3a1-411d-4b96-a3b8-1652a0215e81 tempest-SnapshotDependencyTests-154617986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1" returned: 0 in 0.386s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6b6da3a1-411d-4b96-a3b8-1652a0215e81 tempest-SnapshotDependencyTests-154617986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:47 devstack sudo[105476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1
Nov 05 10:03:47 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:47 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5726cef7-c254-4992-b7dc-50dde792200b tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2.08b559d7-d69b-493e-9000-8842988fd0a4" returned: 0 in 0.346s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5726cef7-c254-4992-b7dc-50dde792200b tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2.08b559d7-d69b-493e-9000-8842988fd0a4 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:47 devstack sudo[105481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2.08b559d7-d69b-493e-9000-8842988fd0a4
Nov 05 10:03:47 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:47 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6b6da3a1-411d-4b96-a3b8-1652a0215e81 tempest-SnapshotDependencyTests-154617986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-d6daef5c-64d3-4d3f-9b66-40516b330ed1" returned: 0 in 0.277s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6b6da3a1-411d-4b96-a3b8-1652a0215e81 tempest-SnapshotDependencyTests-154617986 None] Lock "cinder-quobyte-d6daef5c-64d3-4d3f-9b66-40516b330ed1" released by "delete_volume" :: held 0.736s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:47 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-6b6da3a1-411d-4b96-a3b8-1652a0215e81 tempest-SnapshotDependencyTests-154617986 None] Created reservations ['60fc7f3d-f375-4d0d-bc2a-630e3865df53', 'cb06fe09-f35e-4dc4-a17c-aef72f96e70e', 'd376fa72-805e-405f-b2a0-ae77b3d3b4e0', '382f5814-eb3c-4d96-9290-f8bb70dfb5cc'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:03:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6b6da3a1-411d-4b96-a3b8-1652a0215e81 tempest-SnapshotDependencyTests-154617986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:03:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6b6da3a1-411d-4b96-a3b8-1652a0215e81 tempest-SnapshotDependencyTests-154617986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:03:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6b6da3a1-411d-4b96-a3b8-1652a0215e81 tempest-SnapshotDependencyTests-154617986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:03:47 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6b6da3a1-411d-4b96-a3b8-1652a0215e81 tempest-SnapshotDependencyTests-154617986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:03:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6b6da3a1-411d-4b96-a3b8-1652a0215e81 tempest-SnapshotDependencyTests-154617986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:03:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6b6da3a1-411d-4b96-a3b8-1652a0215e81 tempest-SnapshotDependencyTests-154617986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:47 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:47 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-5726cef7-c254-4992-b7dc-50dde792200b tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2.08b559d7-d69b-493e-9000-8842988fd0a4" returned: 0 in 0.265s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:47 devstack sudo[105485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:03:47 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5726cef7-c254-4992-b7dc-50dde792200b tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-08b559d7-d69b-493e-9000-8842988fd0a4" released by "_delete_snapshot" :: held 1.544s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:47 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5726cef7-c254-4992-b7dc-50dde792200b tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2" released by "delete_snapshot" :: held 1.566s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:47 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-5726cef7-c254-4992-b7dc-50dde792200b tempest-ProjectMemberTests-1394267937 None] Created reservations ['7b3f3f72-f79b-4ece-93f9-097475acabd3', '068b4521-3c9b-4470-aae0-87685e309f22', '1584b00d-557e-4b75-ac08-b72f16cc0bf3', '93cc4728-dd84-428b-8d6e-c6fbe4c44249'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:03:48 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-5726cef7-c254-4992-b7dc-50dde792200b tempest-ProjectMemberTests-1394267937 None] Delete snapshot completed successfully.
Nov 05 10:03:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-5726cef7-c254-4992-b7dc-50dde792200b tempest-ProjectMemberTests-1394267937 None] Lock "cinder-08b559d7-d69b-493e-9000-8842988fd0a4-delete_snapshot" released by "delete_snapshot" :: held 1.746s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-75320e53-d6d7-4e28-85d4-0e9ffd50104b tempest-SnapshotDependencyTests-154617986 None] Acquiring lock "cinder-0c2a466b-e30d-4266-85b7-fc5b53e6e3b3-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-75320e53-d6d7-4e28-85d4-0e9ffd50104b tempest-SnapshotDependencyTests-154617986 None] Lock "cinder-0c2a466b-e30d-4266-85b7-fc5b53e6e3b3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:48 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6b6da3a1-411d-4b96-a3b8-1652a0215e81 tempest-SnapshotDependencyTests-154617986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.291s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:48 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-6b6da3a1-411d-4b96-a3b8-1652a0215e81 tempest-SnapshotDependencyTests-154617986 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:03:48 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-6b6da3a1-411d-4b96-a3b8-1652a0215e81 tempest-SnapshotDependencyTests-154617986 None] Deleted volume successfully.
Nov 05 10:03:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-75320e53-d6d7-4e28-85d4-0e9ffd50104b tempest-SnapshotDependencyTests-154617986 None] Acquiring lock "cinder-quobyte-0c2a466b-e30d-4266-85b7-fc5b53e6e3b3" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-6b6da3a1-411d-4b96-a3b8-1652a0215e81 tempest-SnapshotDependencyTests-154617986 None] Lock "cinder-d6daef5c-64d3-4d3f-9b66-40516b330ed1-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-75320e53-d6d7-4e28-85d4-0e9ffd50104b tempest-SnapshotDependencyTests-154617986 None] Lock "cinder-quobyte-0c2a466b-e30d-4266-85b7-fc5b53e6e3b3" acquired by "delete_volume" :: waited 0.024s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:48 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3483034-0a50-4959-83d8-ddfbdbd03874]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:03:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-75320e53-d6d7-4e28-85d4-0e9ffd50104b tempest-SnapshotDependencyTests-154617986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0c2a466b-e30d-4266-85b7-fc5b53e6e3b3 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:48 devstack sudo[105522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0c2a466b-e30d-4266-85b7-fc5b53e6e3b3
Nov 05 10:03:48 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c174c859-54da-4922-9721-de8b255f022e tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c174c859-54da-4922-9721-de8b255f022e tempest-ProjectMemberTests-1394267937 None] Lock "cinder-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c174c859-54da-4922-9721-de8b255f022e tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-quobyte-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c174c859-54da-4922-9721-de8b255f022e tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2" acquired by "delete_volume" :: waited 0.021s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:48 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a694aac-64a0-4f44-b2c9-31a0840a923a]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:03:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c174c859-54da-4922-9721-de8b255f022e tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:48 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-75320e53-d6d7-4e28-85d4-0e9ffd50104b tempest-SnapshotDependencyTests-154617986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0c2a466b-e30d-4266-85b7-fc5b53e6e3b3" returned: 0 in 0.414s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-75320e53-d6d7-4e28-85d4-0e9ffd50104b tempest-SnapshotDependencyTests-154617986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0c2a466b-e30d-4266-85b7-fc5b53e6e3b3 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:48 devstack sudo[105530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0c2a466b-e30d-4266-85b7-fc5b53e6e3b3
Nov 05 10:03:48 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:48 devstack sudo[105529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2
Nov 05 10:03:48 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:48 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-75320e53-d6d7-4e28-85d4-0e9ffd50104b tempest-SnapshotDependencyTests-154617986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-0c2a466b-e30d-4266-85b7-fc5b53e6e3b3" returned: 0 in 0.257s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:48 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-75320e53-d6d7-4e28-85d4-0e9ffd50104b tempest-SnapshotDependencyTests-154617986 None] Lock "cinder-quobyte-0c2a466b-e30d-4266-85b7-fc5b53e6e3b3" released by "delete_volume" :: held 0.715s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:48 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-75320e53-d6d7-4e28-85d4-0e9ffd50104b tempest-SnapshotDependencyTests-154617986 None] Created reservations ['4dab7686-0e1e-4a3c-a19a-e39a30f4d4a9', '1d17d787-1680-42e3-9b86-4983da3d1331', '71b44ec7-2b7f-4b8b-ae10-31116cffeaed', 'c76dfdf0-1267-447e-b82c-ab529e89fd9c'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:03:48 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c174c859-54da-4922-9721-de8b255f022e tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2" returned: 0 in 0.402s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:48 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c174c859-54da-4922-9721-de8b255f022e tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:49 devstack sudo[105537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2
Nov 05 10:03:49 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-75320e53-d6d7-4e28-85d4-0e9ffd50104b tempest-SnapshotDependencyTests-154617986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:03:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-75320e53-d6d7-4e28-85d4-0e9ffd50104b tempest-SnapshotDependencyTests-154617986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:03:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-75320e53-d6d7-4e28-85d4-0e9ffd50104b tempest-SnapshotDependencyTests-154617986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:03:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-75320e53-d6d7-4e28-85d4-0e9ffd50104b tempest-SnapshotDependencyTests-154617986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:03:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-75320e53-d6d7-4e28-85d4-0e9ffd50104b tempest-SnapshotDependencyTests-154617986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:03:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-75320e53-d6d7-4e28-85d4-0e9ffd50104b tempest-SnapshotDependencyTests-154617986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:49 devstack sudo[105539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:03:49 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:49 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c174c859-54da-4922-9721-de8b255f022e tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2" returned: 0 in 0.278s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c174c859-54da-4922-9721-de8b255f022e tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2" released by "delete_volume" :: held 0.746s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:49 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-c174c859-54da-4922-9721-de8b255f022e tempest-ProjectMemberTests-1394267937 None] Created reservations ['21a57e43-901e-4e74-a1ee-3be07b558f19', 'ccb4693b-eac5-4e45-998c-5fc129a49a1a', '5cfd6421-86fb-4a0d-8280-7bbfb899a2e2', '3f6bee2a-8e96-4b6b-bac6-28740ee6323e'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:03:49 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-75320e53-d6d7-4e28-85d4-0e9ffd50104b tempest-SnapshotDependencyTests-154617986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.288s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:49 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-75320e53-d6d7-4e28-85d4-0e9ffd50104b tempest-SnapshotDependencyTests-154617986 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:03:49 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-75320e53-d6d7-4e28-85d4-0e9ffd50104b tempest-SnapshotDependencyTests-154617986 None] Deleted volume successfully.
Nov 05 10:03:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-75320e53-d6d7-4e28-85d4-0e9ffd50104b tempest-SnapshotDependencyTests-154617986 None] Lock "cinder-0c2a466b-e30d-4266-85b7-fc5b53e6e3b3-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c174c859-54da-4922-9721-de8b255f022e tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:03:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c174c859-54da-4922-9721-de8b255f022e tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:03:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c174c859-54da-4922-9721-de8b255f022e tempest-ProjectMemberTests-1394267937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:03:49 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-c174c859-54da-4922-9721-de8b255f022e tempest-ProjectMemberTests-1394267937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:03:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-c174c859-54da-4922-9721-de8b255f022e tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:03:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c174c859-54da-4922-9721-de8b255f022e tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:49 devstack sudo[105543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:03:49 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:49 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:49 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c174c859-54da-4922-9721-de8b255f022e tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.279s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:49 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-c174c859-54da-4922-9721-de8b255f022e tempest-ProjectMemberTests-1394267937 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:03:49 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c174c859-54da-4922-9721-de8b255f022e tempest-ProjectMemberTests-1394267937 None] Deleted volume successfully.
Nov 05 10:03:49 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c174c859-54da-4922-9721-de8b255f022e tempest-ProjectMemberTests-1394267937 None] Lock "cinder-41621fbe-ed1f-47a8-9bf0-72e85a9d29a2-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:50 devstack cinder-volume[86649]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86649) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 10:03:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] Flow 'volume_create_manager' (a0d67a13-93e0-4614-abe6-cb3640a4fe47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:03:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8538cf3-293c-4115-8e81-27ee77aaebf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8538cf3-293c-4115-8e81-27ee77aaebf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-837239616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ca60c54-7c8a-415a-958b-736ded756912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e528f8801a4697bc8112c19f08f0c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:03:50Z,use_quota=True,user_id='db806d37a63442189c00f5196322142a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (815ad02e-33eb-4b5e-892d-d1cd6d886ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (815ad02e-33eb-4b5e-892d-d1cd6d886ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ebe448-90ff-48ca-847e-8fe1874ca007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ebe448-90ff-48ca-847e-8fe1874ca007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ca60c54-7c8a-415a-958b-736ded756912', 'volume_name': 'volume-1ca60c54-7c8a-415a-958b-736ded756912', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21cd258e-d507-4a1d-a5b6-174a97dd17aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21cd258e-d507-4a1d-a5b6-174a97dd17aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:50 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (152f73b6-a4e8-4360-89b3-dfbf6b71ef7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:50 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] Volume 1ca60c54-7c8a-415a-958b-736ded756912: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ca60c54-7c8a-415a-958b-736ded756912', 'volume_size': 1}
Nov 05 10:03:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:03:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:03:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7841a76c69f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T09:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-837239616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ca60c54-7c8a-415a-958b-736ded756912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e528f8801a4697bc8112c19f08f0c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:03:50Z,use_quota=True,user_id='db806d37a63442189c00f5196322142a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69b4880a-c7c2-4b01-9573-d25f865a1e33),volume_type_id=69b4880a-c7c2-4b01-9573-d25f865a1e33)}" {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 10:03:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] Creating volume 1ca60c54-7c8a-415a-958b-736ded756912 {{(pid=86649) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 10:03:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:03:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:03:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:03:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:03:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:03:50 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] Selected osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1 as target Quobyte volume. {{(pid=86649) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 10:03:50 devstack cinder-volume[86649]: INFO cinder.volume.drivers.remotefs [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] casted to osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1
Nov 05 10:03:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912 1073741824 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:50 devstack sudo[105547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912 1073741824
Nov 05 10:03:50 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:50 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912 1073741824" returned: 0 in 0.480s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:50 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:50 devstack sudo[105554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912
Nov 05 10:03:50 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:51 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912" returned: 0 in 0.285s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:51 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'} {{(pid=86649) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 10:03:51 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:03:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (152f73b6-a4e8-4360-89b3-dfbf6b71ef7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ca60c54-7c8a-415a-958b-736ded756912', 'volume_size': 1}' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a322f405-ae57-475c-82cf-314cc3c5fc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 10:03:51 devstack cinder-volume[86649]: INFO cinder.volume.flows.manager.create_volume [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] Volume volume-1ca60c54-7c8a-415a-958b-736ded756912 (1ca60c54-7c8a-415a-958b-736ded756912): created successfully
Nov 05 10:03:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a322f405-ae57-475c-82cf-314cc3c5fc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86649) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 10:03:51 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] Flow 'volume_create_manager' (a0d67a13-93e0-4614-abe6-cb3640a4fe47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86649) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 10:03:51 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-6aa786f0-b42f-475a-bddc-bdbfb6033d90 tempest-ProjectMemberTests-1394267937 None] Created volume successfully.
Nov 05 10:03:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-11bae2f3-2d8c-4e8f-b429-d6f2dabe2383 tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:03:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-11bae2f3-2d8c-4e8f-b429-d6f2dabe2383 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:03:52 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-11bae2f3-2d8c-4e8f-b429-d6f2dabe2383 tempest-ProjectMemberTests-1394267937 None] Creating offline snapshot e3ab1482-cd25-426e-aec7-aa4148d43c8e of volume 1ca60c54-7c8a-415a-958b-736ded756912 {{(pid=86649) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 10:03:52 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee912d67-e602-476f-a0d9-44cf1c58c11b]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:03:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11bae2f3-2d8c-4e8f-b429-d6f2dabe2383 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:52 devstack sudo[105557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912
Nov 05 10:03:52 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:52 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11bae2f3-2d8c-4e8f-b429-d6f2dabe2383 tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912" returned: 0 in 0.427s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:52 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11bae2f3-2d8c-4e8f-b429-d6f2dabe2383 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912.e3ab1482-cd25-426e-aec7-aa4148d43c8e 1G {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:52 devstack sudo[105562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912.e3ab1482-cd25-426e-aec7-aa4148d43c8e 1G
Nov 05 10:03:52 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:53 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11bae2f3-2d8c-4e8f-b429-d6f2dabe2383 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912.e3ab1482-cd25-426e-aec7-aa4148d43c8e 1G" returned: 0 in 0.488s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11bae2f3-2d8c-4e8f-b429-d6f2dabe2383 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ca60c54-7c8a-415a-958b-736ded756912 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912.e3ab1482-cd25-426e-aec7-aa4148d43c8e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:53 devstack sudo[105568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ca60c54-7c8a-415a-958b-736ded756912 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912.e3ab1482-cd25-426e-aec7-aa4148d43c8e
Nov 05 10:03:53 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:53 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11bae2f3-2d8c-4e8f-b429-d6f2dabe2383 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ca60c54-7c8a-415a-958b-736ded756912 -F qcow2 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912.e3ab1482-cd25-426e-aec7-aa4148d43c8e" returned: 0 in 0.329s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:53 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-11bae2f3-2d8c-4e8f-b429-d6f2dabe2383 tempest-ProjectMemberTests-1394267937 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912.e3ab1482-cd25-426e-aec7-aa4148d43c8e is being set with open permissions: ugo+rw
Nov 05 10:03:53 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11bae2f3-2d8c-4e8f-b429-d6f2dabe2383 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912.e3ab1482-cd25-426e-aec7-aa4148d43c8e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:53 devstack sudo[105574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912.e3ab1482-cd25-426e-aec7-aa4148d43c8e
Nov 05 10:03:53 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:54 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11bae2f3-2d8c-4e8f-b429-d6f2dabe2383 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912.e3ab1482-cd25-426e-aec7-aa4148d43c8e" returned: 0 in 0.289s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11bae2f3-2d8c-4e8f-b429-d6f2dabe2383 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:54 devstack sudo[105577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912.info
Nov 05 10:03:54 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:54 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11bae2f3-2d8c-4e8f-b429-d6f2dabe2383 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912.info" returned: 0 in 0.283s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:54 devstack cinder-volume[86649]: WARNING cinder.volume.drivers.remotefs [None req-11bae2f3-2d8c-4e8f-b429-d6f2dabe2383 tempest-ProjectMemberTests-1394267937 None] /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912.info is being set with open permissions: ugo+rw
Nov 05 10:03:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11bae2f3-2d8c-4e8f-b429-d6f2dabe2383 tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912.info {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:54 devstack sudo[105580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912.info
Nov 05 10:03:54 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:54 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-11bae2f3-2d8c-4e8f-b429-d6f2dabe2383 tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912.info" returned: 0 in 0.301s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:54 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-11bae2f3-2d8c-4e8f-b429-d6f2dabe2383 tempest-ProjectMemberTests-1394267937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.213s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:03:54 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-11bae2f3-2d8c-4e8f-b429-d6f2dabe2383 tempest-ProjectMemberTests-1394267937 None] Create snapshot completed successfully
Nov 05 10:03:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c031fb41-339d-4fb7-8f27-b12a6b92df7f tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-e3ab1482-cd25-426e-aec7-aa4148d43c8e-delete_snapshot" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c031fb41-339d-4fb7-8f27-b12a6b92df7f tempest-ProjectMemberTests-1394267937 None] Lock "cinder-e3ab1482-cd25-426e-aec7-aa4148d43c8e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c031fb41-339d-4fb7-8f27-b12a6b92df7f tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-quobyte-1ca60c54-7c8a-415a-958b-736ded756912" by "delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c031fb41-339d-4fb7-8f27-b12a6b92df7f tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-1ca60c54-7c8a-415a-958b-736ded756912" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c031fb41-339d-4fb7-8f27-b12a6b92df7f tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-quobyte-e3ab1482-cd25-426e-aec7-aa4148d43c8e" by "_delete_snapshot" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:55 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c031fb41-339d-4fb7-8f27-b12a6b92df7f tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-e3ab1482-cd25-426e-aec7-aa4148d43c8e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c031fb41-339d-4fb7-8f27-b12a6b92df7f tempest-ProjectMemberTests-1394267937 None] Deleting offline snapshot e3ab1482-cd25-426e-aec7-aa4148d43c8e of volume 1ca60c54-7c8a-415a-958b-736ded756912 {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 10:03:55 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c031fb41-339d-4fb7-8f27-b12a6b92df7f tempest-ProjectMemberTests-1394267937 None] snapshot_file for this snap is: volume-1ca60c54-7c8a-415a-958b-736ded756912.e3ab1482-cd25-426e-aec7-aa4148d43c8e {{(pid=86649) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 10:03:55 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[6186496d-6a9b-46ec-b415-b6c1b133c733]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:03:55 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c031fb41-339d-4fb7-8f27-b12a6b92df7f tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912.e3ab1482-cd25-426e-aec7-aa4148d43c8e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:55 devstack sudo[105584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912.e3ab1482-cd25-426e-aec7-aa4148d43c8e
Nov 05 10:03:55 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:56 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c031fb41-339d-4fb7-8f27-b12a6b92df7f tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912.e3ab1482-cd25-426e-aec7-aa4148d43c8e" returned: 0 in 0.394s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:56 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.remotefs [None req-c031fb41-339d-4fb7-8f27-b12a6b92df7f tempest-ProjectMemberTests-1394267937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ca60c54-7c8a-415a-958b-736ded756912(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86649) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 10:03:56 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fc7962-7307-4f7b-a53b-ccfc435f5882]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:03:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c031fb41-339d-4fb7-8f27-b12a6b92df7f tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:56 devstack sudo[105589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912
Nov 05 10:03:56 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:56 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c031fb41-339d-4fb7-8f27-b12a6b92df7f tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912" returned: 0 in 0.369s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:56 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c031fb41-339d-4fb7-8f27-b12a6b92df7f tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912.e3ab1482-cd25-426e-aec7-aa4148d43c8e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:56 devstack sudo[105594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912.e3ab1482-cd25-426e-aec7-aa4148d43c8e
Nov 05 10:03:56 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:57 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c031fb41-339d-4fb7-8f27-b12a6b92df7f tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912.e3ab1482-cd25-426e-aec7-aa4148d43c8e" returned: 0 in 0.327s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c031fb41-339d-4fb7-8f27-b12a6b92df7f tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912.e3ab1482-cd25-426e-aec7-aa4148d43c8e {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:57 devstack sudo[105599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912.e3ab1482-cd25-426e-aec7-aa4148d43c8e
Nov 05 10:03:57 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:57 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:57 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-c031fb41-339d-4fb7-8f27-b12a6b92df7f tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912.e3ab1482-cd25-426e-aec7-aa4148d43c8e" returned: 0 in 0.281s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c031fb41-339d-4fb7-8f27-b12a6b92df7f tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-e3ab1482-cd25-426e-aec7-aa4148d43c8e" released by "_delete_snapshot" :: held 1.517s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c031fb41-339d-4fb7-8f27-b12a6b92df7f tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-1ca60c54-7c8a-415a-958b-736ded756912" released by "delete_snapshot" :: held 1.543s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:57 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-c031fb41-339d-4fb7-8f27-b12a6b92df7f tempest-ProjectMemberTests-1394267937 None] Created reservations ['7c5d0692-8905-436d-a8b6-ffd95cf46847', '2d547a35-a703-42ed-8893-bb009cc285d5', '42b35cc2-2d24-4902-9798-6c552c1e5084', 'd2194a07-de37-4f19-8df4-eab3846cb663'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:03:57 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-c031fb41-339d-4fb7-8f27-b12a6b92df7f tempest-ProjectMemberTests-1394267937 None] Delete snapshot completed successfully.
Nov 05 10:03:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-c031fb41-339d-4fb7-8f27-b12a6b92df7f tempest-ProjectMemberTests-1394267937 None] Lock "cinder-e3ab1482-cd25-426e-aec7-aa4148d43c8e-delete_snapshot" released by "delete_snapshot" :: held 1.697s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7b9febbe-b0ba-4883-b664-d2e413cea0cf tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-1ca60c54-7c8a-415a-958b-736ded756912-delete_volume" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7b9febbe-b0ba-4883-b664-d2e413cea0cf tempest-ProjectMemberTests-1394267937 None] Lock "cinder-1ca60c54-7c8a-415a-958b-736ded756912-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:57 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7b9febbe-b0ba-4883-b664-d2e413cea0cf tempest-ProjectMemberTests-1394267937 None] Acquiring lock "cinder-quobyte-1ca60c54-7c8a-415a-958b-736ded756912" by "delete_volume" {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 10:03:58 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7b9febbe-b0ba-4883-b664-d2e413cea0cf tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-1ca60c54-7c8a-415a-958b-736ded756912" acquired by "delete_volume" :: waited 0.017s {{(pid=86649) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 10:03:58 devstack cinder-volume[86649]: DEBUG oslo.privsep.daemon [-] privsep: reply[4853e022-d784-4f94-acaa-a5d42c573178]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 10:03:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7b9febbe-b0ba-4883-b664-d2e413cea0cf tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:58 devstack sudo[105602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912
Nov 05 10:03:58 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:58 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7b9febbe-b0ba-4883-b664-d2e413cea0cf tempest-ProjectMemberTests-1394267937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912" returned: 0 in 0.394s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7b9febbe-b0ba-4883-b664-d2e413cea0cf tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912 {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:58 devstack sudo[105608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912
Nov 05 10:03:58 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:58 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7b9febbe-b0ba-4883-b664-d2e413cea0cf tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d/volume-1ca60c54-7c8a-415a-958b-736ded756912" returned: 0 in 0.267s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:58 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7b9febbe-b0ba-4883-b664-d2e413cea0cf tempest-ProjectMemberTests-1394267937 None] Lock "cinder-quobyte-1ca60c54-7c8a-415a-958b-736ded756912" released by "delete_volume" :: held 0.737s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:03:58 devstack cinder-volume[86649]: DEBUG cinder.quota [None req-7b9febbe-b0ba-4883-b664-d2e413cea0cf tempest-ProjectMemberTests-1394267937 None] Created reservations ['03e97b0c-5c5c-4384-9500-29295b7b0f11', 'fc7df1c4-ae70-44bf-bb45-f462942fdbf7', '7d8eba4f-d9e3-4d92-ba2b-19dfe6cd174c', 'ede3fd04-e5f5-4445-b358-42a685c6b113'] {{(pid=86649) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 10:03:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7b9febbe-b0ba-4883-b664-d2e413cea0cf tempest-ProjectMemberTests-1394267937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:03:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7b9febbe-b0ba-4883-b664-d2e413cea0cf tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:03:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7b9febbe-b0ba-4883-b664-d2e413cea0cf tempest-ProjectMemberTests-1394267937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:03:58 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-7b9febbe-b0ba-4883-b664-d2e413cea0cf tempest-ProjectMemberTests-1394267937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:03:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-7b9febbe-b0ba-4883-b664-d2e413cea0cf tempest-ProjectMemberTests-1394267937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:03:58 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7b9febbe-b0ba-4883-b664-d2e413cea0cf tempest-ProjectMemberTests-1394267937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:03:58 devstack sudo[105611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:03:58 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:03:59 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root
Nov 05 10:03:59 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-7b9febbe-b0ba-4883-b664-d2e413cea0cf tempest-ProjectMemberTests-1394267937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.296s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:03:59 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-7b9febbe-b0ba-4883-b664-d2e413cea0cf tempest-ProjectMemberTests-1394267937 None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:03:59 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-7b9febbe-b0ba-4883-b664-d2e413cea0cf tempest-ProjectMemberTests-1394267937 None] Deleted volume successfully.
Nov 05 10:03:59 devstack cinder-volume[86649]: DEBUG cinder.coordination [None req-7b9febbe-b0ba-4883-b664-d2e413cea0cf tempest-ProjectMemberTests-1394267937 None] Lock "cinder-1ca60c54-7c8a-415a-958b-736ded756912-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=86649) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 10:04:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 10:04:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 10:04:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 10:04:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1': None} {{(pid=86649) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 10:04:00 devstack cinder-volume[86649]: DEBUG cinder.volume.drivers.quobyte [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dd7af60-7daa-456b-94d5-5b4a42affdb1'] {{(pid=86649) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 10:04:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86649) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 10:04:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 10:04:00 devstack sudo[105615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d
Nov 05 10:04:00 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 10:04:00 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root
Nov 05 10:04:00 devstack cinder-volume[86649]: DEBUG oslo_concurrency.processutils [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dbd5f5b21043d771ec13159673ff673d" returned: 0 in 0.278s {{(pid=86649) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 10:04:00 devstack cinder-volume[86649]: DEBUG cinder.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Notifying Schedulers of capabilities ... {{(pid=86649) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 10:04:00 devstack cinder-volume[86649]: DEBUG oslo_service.periodic_task [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] Running periodic task VolumeManager._thread_info {{(pid=86649) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 10:04:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread count: 28 {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 10:04:00 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-d1b143e8-5028-441b-ae32-07b38631fab6 None None] thread info: [<_MainThread(MainThread, started 132223485407360)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132223374597632)>, <Thread(Thread-3 (stat_writer), started daemon 132223371781056)>, <Thread(Rabbit-heartbeat, started daemon 132223371785472)>, <Thread(Thread-5 (_runner), started daemon 132223370891392)>, <Thread(Thread-7 (_runner), started daemon 132223371019776)>, <Thread(fd_logger, started daemon 132223368900288)>, <Thread(privsep_reader, started daemon 132223368890304)>, <Thread(tpool_thread_0, started daemon 132223357408960)>, <Thread(tpool_thread_1, started daemon 132223349016256)>, <Thread(tpool_thread_2, started daemon 132223340623552)>, <Thread(tpool_thread_3, started daemon 132223332230848)>, <Thread(tpool_thread_4, started daemon 132223323838144)>, <Thread(tpool_thread_5, started daemon 132223315445440)>, <Thread(tpool_thread_6, started daemon 132223307052736)>, <Thread(tpool_thread_7, started daemon 132223298660032)>, <Thread(tpool_thread_8, started daemon 132223290250944)>, <Thread(tpool_thread_9, started daemon 132223281841856)>, <Thread(tpool_thread_10, started daemon 132223273432768)>, <Thread(tpool_thread_11, started daemon 132223265023680)>, <Thread(tpool_thread_12, started daemon 132223256614592)>, <Thread(tpool_thread_13, started daemon 132223248205504)>, <Thread(tpool_thread_14, started daemon 132223239796416)>, <Thread(tpool_thread_15, started daemon 132223231387328)>, <Thread(tpool_thread_16, started daemon 132223222978240)>, <Thread(tpool_thread_17, started daemon 132223214569152)>, <Thread(tpool_thread_18, started daemon 132223206160064)>, <Thread(tpool_thread_19, started daemon 132223197750976)>] {{(pid=86649) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 10:04:08 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=100,cinder:SELECT=86,cinder:INSERT=30,cinder:DELETE=8 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 10:04:09 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writing DB stats cinder:UPDATE=101,cinder:SELECT=72,cinder:INSERT=25,cinder:DELETE=9 {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}